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The other theory, which is the natural outgrowth of th 
theory of evolution, maintains that the content of a school sul) 
ject is determined by the use to which it will be put. It quit 
willingly grants that the chemist shall determine the content 
chemistry courses for prospective chemists but it emphaticall, 
maintains that the same right shall be granted for the use 0 
the engineer, the doctor, the housekeeper, the farmer, and th: 
layman. 

The theory of evolution holds that a structure which fun 
tions successfully in one situation may be beneficially modified 
when placed in another situation. The supporters of the theory 
of activity analysis, to apply the parallel with evolution, hold that 
the situation of the specialist as described in terms of his activities 
duties, and problems, is not identical with that of the engineer, 
the doctor, or the layman whose problems and duties are different 
and that, therefore, the structure of the curriculum may well 
be modified more successfully to cope with the differences of each 

But the method of activity analysis advances beyond the law 
of natural selection which operates rather blindly in the field of 
biological life in preserving useful accidental variations. A bw 
logical organism changes its structure through accidental varia 
tion so that when it comes into possession of characteristics which 
are of superior efficiency in controlling a type of situation in 
which it is placed, it tends to retain the useful modifications thus 
more or less accidentally thrust upon it. Rational beings, how 
ever, in developing social organisms, such as the curriculum is 
can advance a step beyond the law of natural selection by first 
making an analysis of the situation to which adjustment is to bh: 
made and then developing an organism which meets these con 
ditions in a superior way. 

This is primarily what activity analysis attempts to do in th: 
field of curriculum construction. The activities in connection 
with which a subject may be used are analyzed to discover exact) 
what the individual is to do and then the subject material neces- 
sary to assist in the performance of these activities is collected 
and organized, For instance, one situation in which the learner | 

Uy 
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Is himself is concerned with the communicating and recording 
facts. Specifically, the laymen writes letters, and children 
ipose original themes. To analyze this situation a count is 
f words—in personal letters and in the writing of children 


lists so obtained become the spelling vocabulary for the ele- 
ry school, which is the school for laymen. For the spelling 
culum of the business college in which stenographers and 
sts are trained, the same method is used but applied to a 
rent situation in which word counts of business letters are 
Arithmetic for the layman may be determined by a col- 

n of arithmetical problems which the layman meets. Mathe- 
tics for chemists is determined by an investigation of the 
thematics used by chemists. The chemistry used in food 
rses is obtained by derivation from the content of food courses 


he grammar necessary for the correction of errors is secured 


fter an analysis of grammatical errors of school children. The 


nglish composition needed by engineers is disclosed by an 
lysis of the uses to which engineers put the subject. The 
ciology needed by the layman is obtained by an examination of 
the social problems which confront the layman, just as the 
ciology needed by the sociologist is determined by the problems 
ncountered in the field of sociology. 

In all_cases the theory of activity analysis holds that the 
structure of a subject varies with its function and its content with 
its use. It leaves a place for the specialists’ organization of the 
curriculum by allowing that the function of the subject for him 
is one of many functions while it opposes the claim that the struc 
ture which is best for the conditions of the specialist meets all 

ther situations equally well. 

The method of activity analysis is profoundly significant and 
is so incompletely understood that the writer has taken the lib- 
erty of presenting some of the problems which have to be met 
in its use. For clarity these will be listed and described as 
dichotomous situations in which the selection of one or another 
of pairs of considerations modify methods of analysis and of 


cu rriculum constructi: mm. 
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Parenthetically, it may be said that an activity analysis is the 
analysis of both the mental and physical activities which are car- 
ried on by individuals. Used in this broad sense, activities include 
not only what people do but what they think, and feel, or will. In 
its most complicated form, the analysis is concerned with a broad 
range of physical actions, feelings, and purposes, as in the analysis 
of the activities of women made for the purpose of constructing 
a college curriculum for women. In its simpler forms, it involves 
the analysis of definite operations, to which the term job analysis 
is applied, as in the analysis of the operations involved in running 
a machine. Between these two extremes are activities displaying 
all gradations of complexity and requiring all degrees of 
analytical ability. 

The first dichotomous situation which causes a modification of 
methods is contained in the distinction between sequential and 
non-sequential activities. By a sequential operation is meant one 
in which the constituent activities normally follow each other in 
regular order. Most personal routine duties are of this sort, 
such as dressing in the morning and baking a cake, or as in 
machinery operations in production plants and the annual calen- 
dars of animal husbandry. Non-sequential activities, on the con- 
trary, are arranged in no regular order in the performance of any 
operation. Specifically, communication of ideas through spelling, 
writing, and language is non-sequential because there is no regu- 
lar order observed in the occurrence of words or rules of syntax 
since their use is dependent upon the demands of varying situa- 
tions. A job analysis of salesmanship, in which all the activities 
or duties are to be listed, is much more difficult than the job 
analysis of cabinet making. A job analysis of home making deals 
with duties some of which are routine and sequential but most of 
which are irregular and non-sequential in their appearance. 

This leads to very marked differences in methods of analysis. 
For sequential jobs, the usual procedure followed by the job 
analyst is to obtain from each of several operators in separate 
interviews a list of his duties, to combine these, to resubmit the 
list to them, and to have it checked by the foreman. In non- 
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sequential jobs the same procedure is used as a basis but from 
knowledge born of experience, the analyst finds that he needs to 
make a supplementary analysis by long continued personal 
observation of the operations and in some cases by a long con- 
tinued performance of the job. A case in point is that of the 
analysis of salesmanship which was made by us last year. Inter- 
views were held with many salespeople for the purpose of obtain- 
ing a list of their difficulties; to this were added interviews with 
several managers and superintendents; but so little was obtained 
from these sources that a member of our staff with competent 
experience in selling, had to be detailed to watch salespeople at 
work daily for three months before we felt that we had a reason- 
ably accurate list of the duties of retail selling. In other words, 
the analysis of non-sequential jobs is much more difficult than 
that of sequential activities and requires a more elaborate 
technique. 

A second bifurcation of methods is necessary according as 
the analyst wishes to make an activity analysis or a difficulty 
analysis. For instance, a spelling vocabulary based upon analysis 
may list either the words most frequently used in correspondence 
or those most frequently misspelled. In the former case the top 
words are such as: tm, all, and, as, and for. While in the latter 
the words which lead the list are: separate, which, there, and 
thetr. 

While theoretically every learned activity at some time or 
another is a difficulty, with the result that eventually the two 
lists are identical, there are practical situations in which the 
activity analysis is not as efficient as the difficulty analysis. For 
in the first place, operators are often unable to report what they 
do because many of their duties have become submerged habits, 
while they may easily be able to recognize the duties with which 
they have difficulty because difficulties require the focusing of 
attention. In the second place, if the analysis is made after 
activities have been partially learned it is extremely important 
to know those with which the learner now has difficulty in order 
that special attention may be given to them. So, in the study 
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of language in the school, to which children come with some pro- 
ficiency in speech, it is less important to know the rules they use 
than the rules they break. For practical purposes, in this case, 
it is unnecessary to teach them rules which they cannot break 
while obviously it 1s of first importance to teach them rules whos 
observance will eliminate error. When the operations have been 
carried along to a position of partial mastery, difficulty analysis 
becomes a necessary method in the construction of a training 
curriculum. 

This is the fundamental position of Bobbitt in his theory of 
curriculum construction, though it can be demonstrated in opp» 
sition to this position that it will hold only where activities have 
been partially learned and is, therefore, not of sufficient breadth 
to determine all the activities which should be included in a schoo! 
curriculum. These can be determined only by an activity analysis, 
to which a difficulty analysis is a necessary supplement in th: 
later stages of learnin«. 

A third distinction of sufficient importance to be mentioned is 
that between what may be called gross analysis and detailed 
analysis. If the analysis is made sufficiently minute it is possible 
so objectively to determine the content of the curriculum that 
the work can be performed in the laboratory; but if the analysis 
ceases before working units are obtained, it becomes necessary to 
supplement the findings of the analyst by conference with faculty 
committees. For instance, a study of the mathematics used in 
chemistry by Williams is carried to sufficient detail for not only 
the operations but their range of complexity to be determined 
with such exactness that a review course may be worked out 
in detail. At no point in the study is any item a matter of opinion. 
So, also, the spelling lists obtained by word counts are sufficiently 
detailed to establish objectively the actual content of the spelling 
curriculum. On the other hand, the job analysis made by Strong 
of the duties of executives, as the basis for a curriculum in com- 
mercial engineering, was so complicated and the pressure of time 
so great that only the broad outlines of the content of the derived 
courses could be determined, with the result that for the comple- 
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tion of the work committees of teachers of all subjects concerned 
become a necessary part of the method. 

Gross analysis, then, is not so objective as detailed analysis, 

nd requires the use of concensus and conference while a detailed 

analysis makes opinion an unnecessary part of the methods of 
curriculum construction. The goal of all curriculum construc- 
ion is the elimination of as much of the subjective element as 
possible, though this cannot be entirely accomplished. 

A fourth distinction in the use of activity analysis arises from 
divergent uses of the analysis. The employment departments of 
commercial and industrial organizations make analyses to obtain 
job specifications while the training departments use them for 
curriculum content. For job specification, it 1s necessary to list 
only what is to be done by an operator in a specific position so 
that when the employment office is called upon to select a person 
for the position he will know the nature of the job. For curricu- 
lum construction, it is necessary to supplement this information 
about what is to be done with additional information as to how 
the operations are to be performed. For these reasons the job 
specification is much less detailed, and as a matter of fact it is 
usually found that the curriculum cannot be based upon the em- 
ployment department’s job specifications. New analyses have to 
he made by the training department with much greater attention 
to the details of the operations. Theoretically, the job specifica- 
tion is the proper basis for the training program; but because of 
these differences in function those job specifications found in 
employment offices will not usually suffice. 

This leads naturally to a fifth distinction which may be stated 
in the form of a question. Shall training departments teach the 
installed methods of job performance or the best methods? The 
obvious alternative is the latter, but practical considerations may 
cause a change of opinion. For instance, if in the training of 
operatives in the correspondence division of a large department 
store the management asks the training department to make a 
change in the system as well, it is in effect asking it not only to 
teach but to reorganize. So, because of the expense and time 
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involved, it may be advisable for the training department to teach 
the imperfect installed procedure rather than to effect a more 
efficient procedure before the training program is begun. Yet, 
it may be said parenthetically, that in business the tendency is 
toward placing both training and organization on the shoulders 
of the training department, especially when a radical reorganiza- 
tion is not required. 

Nor are the schools free from this problem. Superficially, it 
seems self-evident that only the best methods of performing 
activities should be taught in the school. But in practice it is 
often a question whether this is wise. Is it advisable, for ex- 
ample, to advocate the best methods of solving social and political 
problems (the best being determined by the judgment of con- 
scientious teachers) if it is not practically possible to make the 
necessary reorganization of social institutions which will permit 
the most efficient methods to be used? In these difficult cases the 
wise teacher modifies his best in such a way as to make it the 
best possible under existing conditions and teaches his students 
the methods by which reorganization of social institutions may 
be effected. But in either case the curriculum is affected by the 
point of view which is chosen. 

The sixth consideration is the distinction between ideals and 
activities. An activity analysis is not sufficient to determine the 
curriculum unless standards of performance are set up by which 
to make a selection of methods. This is done by the determina- 
tion of ideals, which dominate the performance of the activities. 
This is recognized informally in the selection of men in business 
by the inclusion in the job specification of both the duties to be 
performed and the personal qualities desired. Some positions 
require courtesy, others demand scholarliness, and all require 
honesty and conscientiousness. So in building a curriculum it 
is necessary to determine both activities and ideals. For instance, 
a secretary may have the duties of answering the telephone and 
of meeting callers. These may be done in several ways but 
obviously the ideal of courtesy is so important that only cour- 
teous methods of answering the telephone and of meeting callers 
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will be selected. Merely to perform these duties, or to perform 
them with wrong ideals, will not lead to efficiency. 

Consequently in school as in business the determination of 
standards in the guise of ideals is an essential part of all curricu- 
lum construction. So important is this procedure that faculties 
should conscientiously and reflectively determine the ideals whose 
stamp their graduates shall bear and then apply the appropriate 
ideals as standards for the selection of alternative methods of 
performance. Long and laborious as this procedure is, it is the 
only method by which the curriculum can be built or can be 
acquired. In all curriculum construction, the ideals must be 
determined before the methods for performing the activities 
obtained by analysis can be selected. 

Of a somewhat different sort is the seventh bifurcation. This 
lies in the distinction between primary subjects and derived sub- 
jects. To clarify this distinction an illustration may be given. 
\When in the major job analysis made by Strong the duties of 
the executives of certain industrial organizations had been ascer- 
tained and the information necessary to perform them had been 
listed, there was found to be a large amount of English, of psy- 
chology, and of economics, but only a very short list of the prin- 
ciples of physics. So far as the primary subjects, that is those 
discovered in the analysis, were concerned physics was judged to 
be relatively unimportant; but this did not mean that no other 
items of physics were necessary. For, when the primary sub- 
jects, such as mechanics, were examined, it was found that physi- 
cal laws were necessary for their mastery. So, to obtain a full 
curriculum in physics it was necessary to list all the items of 
phvsics revealed in the primary analysis and to derive from the 
other subjects the additional items of physics necessary to under- 
stand them. 

This means that the so called fundamental service subjects of 
mathematics, chemistry, physics, sociology, or history are essen- 
tially derived subjects rather than primary subjects revealed in 
the analysis. It may be said in passing that this explains in part 
the statement of professional men that they do not use their 
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fundamental subjects and explodes the claim sometimes made that 
because they do not use them, they should not learn them. For, 
obviously, at one time it was necessary for them to learn thy 
fundamental subjects in order to understand methods which they 
now use; and it is legitimate to forget items once the basic use for 
them has ceased. However, this does not mean that the method 
of specialistic determination is to be followed. It is still necessary 
for the fundamental service subjects to be derived by activity 
analysis so as to include only what must be understood; but it 
is not a matter for alarm if later they are forgotten after use 
for them has disappeared. 

Finally, a distinction needs to be made between the vocational! 
elements and the extra-vocational elements in the curriculum of 
the vocational school. The vocational portions of the curriculum 
can be obtained by the analysis of vocational activities and the 
material may be collected under the domination of selected ideals 

Sut just as the doctor or the engineer is something more than 
a mere doctor or engineer because he has extra-vocational re- 
sponsibilities and interest in his family, his friends, and his civic 
problems, so the curriculum of the vocational school must include 
more subject material than is obtained from a job analysis of 
the vocation. 

Two analyses are necessary, a vocational analysis and an 
extra-vocational analysis. The activities and interests of extra- 
vocational life, those problems and interests which all men have, 
irrespective of vocation, must be analyzed by the same methods 
as are used in the vocational analysis. 

At present the extra-vocational content is determined nega- 
tively. A few hours are set aside in the course of study for so 
called cultural subjects and the selection of courses to fill them 
is largely left to chance. What we advocate is a positive approach 
to the question through an activity analysis of extra-vocational 
life from which can be definitely determined what will be of most 
use for the individual in furthering those interests and needs 
which are not directly connected with the vocation. 
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Other considerations might be presented to illustrate the prob- 
lems of curriculum construction but enough have been mentioned 
t» show the possibilities and the difficulties of activity analysis. 

In conclusion, the foregoing considerations demand that when 
ctivities are analyzed, ideals and standards must be set up to aid 

the selection of subject material; that in analyzing activities, 
lifficulty analyses may supplement activity analyses; and that 
in all cases the analysis should be as detailed as possible in order 
secure the largest measure of scientific objectivity. Non- 


/ 


equential jobs are difficult of analysis but the task is neither im- 
possible nor impractical. The content of subjects may be of 
direct use in activities or may be derived from subjects which are 
of direct use, as the basis upon which they rest. Finally all 
courses of study in vocational schools must include not only voca- 
tional but also extra-vocational content, beth obtained by the 
analysis of activities—the former by an analysis of the vocation 


and the latter by an analysis of extra-vocational life. 
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THE EFFECTS OF SUPERVISED STUDY IN ENGLISH 
COMPOSITION 


J. W. Hecxert 
Miami University 

Teaching children how to study has come to be considered 
one of the important ends in the educative process. It has taken 
its place by the side of useful information, skills, ideals, atti- 
tudes, and prejudices, as deserving of the efforts of the teacher 
We have learned in our elementary and high schools, as in our 
best graduate and technical schools, that the test applied to the 
learner should not be merely, “What does he know?” but rather, 
“What can he do independently of the teacher?” 

Various plans have been devised for the purpose of teaching 
children to study. The present investigation concerns itself with 
the efficiency of the so called divided or double-period plan, by 
which the first half of a period is given to class discussion and 
assignment while the second half is given to supervising the 
work of children upon the new assignment. The modification 
used in this experiment consisted in the fact that the teacher 
did not definitely adhere to so rigid a division of time for recita- 
tion and study purposes respectively, but called children to a 
class discussion whenever there was something worth while to 
discuss, and permitted them to work or study the remainder of 
the time. , 

Many claims have been made for the efficacy of the double 
period plan. Some of these are probably well founded, others are 
not, for in some instances the judgments are based upon careful 
investigations; in other cases the opinion of teacher or superin- 
tendent is regarded as sufficient proof of the efficacy of the plan. 
One of the more recent investigations of the problem of super- 
vised study in the divided- or double-period plan was made by 
Professor Breed of the University of Chicago and others, under 
the auspices of The Michigan School Masters’ Club. Professor 
Breed investigated the effect of supervised study “when carried 


368 





— 








May, 1922 EFFECTS OF SUPERVISED STUDY 369 


on by this plan under actual school conditions in thirteen high 
schools of Michigan and one of Minnesota with the aim of throw- 
ing additional light on the effectiveness of a common form of 
organization of supervised study.” Breed’s conclusions are stated 
by him as follows: 

“1. On the basis of average results for whole classes, super- 
vised study of the type tested was slightly less efficient in first- 
year algebra, and much less efficient in ninth-grade composition, 
and was more efficient in first-year Latin, than non-supervision. 

“2. Supervised study of the kind tested facilitated the pro- 
gress of the poorer pupils, and to a correspondingly greater de- 
gree retarded the progress of the better pupils. 

“3. The divided- and double-period plans should not be 
urged for general adoption in secondary schools until their effi- 
ciency is more clearly demonstrated. 

“4. Until the divided- and double-period plans meet the ob- 
jections urged against them, a selective or differential plan of 
study-supervision should be favored by secondary schools, that 
is, a plan which concentrates upon pupils of less ability. 

“s. The technique of supervising the study of the poorer 
pupils needs to be improved; a technique of supervising the 
study of brighter pupils needs to be developed.” 

It seemed to the writer, however, that Breed’s method of 
procedure was open to objection in some particulars. Classes 
were divided upon the basis of previous attainments in English 
composition as indicated by teacher’s grades (semester) and a 
preliminary test. Under such a plan it was impossible to make 
allowance for the very capable child who writes a rather poor 
composition and the slow, plodding child who, because of very 
constant application has succeeded in attaining a comparatively 
high score but whose further progress is limited by his lack of 
capacity. Again the basis of Breed’s statistics are teachers’ 
marks unaided by any scales. It would seem that the rating of 
the papers could have been materially improved by means of 
one of the several composition meters now available. In the 
third place it would seem that little was done in this investigation 
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to apprise the teachers participating of the real significance o; 
supervised study. To be sure the teachers were referred + 
Whipple’s Manual, but this very reference implied a miscon- 
ception of the problem involved in teaching children how w 
work more intelligently on their compositions, as will be shown 
later, and the teachers could receive but little assistance upon « 
point on which it was most needed to make the investigation « 
success. Breed agrees with Parker when he holds that the poor 
students appear to profit most from supervised study and the 
bright pupils are actually retarded by this method. However, 
it seemed to the writer that a capable teacher who studies th« 
special needs of the bright child must be able to teach him better 
methods of work; if she cannot, why should such children he 
required to attend class exercises at all the very purpose of which 
always is to teach better methods of work? It would seem that 
the loss of the bright child in the supervised study period is to 
be accounted for rather by the inability of the teacher to under- 
stand his needs and therefore to deal with him intelligently. 

The object of the present investigation was to ascertain (1) 
whether supervised study in English composition under the 
divided-period plan or its modifications, when the teacher knows 
the technique of directing study in this subject, that is, when 
she knows what to do with the children of varying ability in 
order to improve their methods of writing compositions, whether 
such a plan is less efficient than unsupervised study of this sub- 
ject; (2) whether the poorer pupils necessarily profit most from 
supervised study and the brighter pupils not only profit less but 
are actually suffering from the interference resulting from super- 
vised study; (3) what are the best methods of teaching children 
to improve their methods of work in writing English 
compositions ? 

This experiment was conducted with the ninth grade of the 
William McGuffey High School at Miami University. The Na- 
tional Intelligence Test had been given at the beginning of the 
vear. The coefficient of brightness was computed for each child. 
The entire class was also given two preliminary tests in compo- 
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<ition writing to ascertain the initial attainments of each pupil. 
The papers were rated by means of the Thorndike-Hilligas scale. 
The class was then divided into two groups each of seventeen 
pupils of approximately equal ability, constituted as follows: 

The supervised group had coefficients of brightness totaling 
1766 points and composition scores totalling 938.4 points; the 
unsupervised group had coefficients of brightness totalling 1707 

ints and composition scores totalling 990.8 points. The ad- 
vantage in intelligence, therefore seemed to be slightly in favor 
of the supervised group while the unsupervised group had the 
advantage in initial attainments in composition writing. 

The two groups were taught by the same teacher, Miss Mar- 
cuerite Royal, staff teacher of English. Each group worked 
for twenty-five periods of one hour each. Of these periods seven 
were given during December and January 1920-1921, one period 
a week; eighteen were given during April and May, 1921, th 
two groups alternating from day to day. Illness of the teacher 
interrupted the experiment during February and March. The 
writer assisted the class teacher in directing the work of the 
supervised group, primarily for the purpose of developing a 
method of procedure; the teacher, however, had charge of the 
recitation in the supervised as in the unsupervised class. In 
hoth groups, the teacher attempted to arouse as much enthusiasm 
for the work as possible in order that every child might do his 
best. In this she succeeded for we never had keener interest 
in the writing of compositions. 

Our principal task was to devise a method of procedure for 
directing the work. We decided first of all, to attack the more 
fundamental aspects of composition writing, how to choose the 
subject for a composition, how to plan the materials to be used 
in the development of the subject, how to arrange these materials, 
what an outline is for, and how to word it and use it. The chief 
emphasis throughout was placed upon having something to say 
and saying it in such a way that it would be clear and interesting 
to an audience. Occasionally a half hour was set aside for the 
purpose of enjoying the stories written. In order to teach chil- 
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dren to be more successful in criticising their own productions 
they were encouraged, first, to go over their compositions in the 
light of the principles they had been taught, and second, to meet 
with one or two of their classmates for the purpose of going 
over their compositions. 

The various phases of composition writing were then furthe: 
analysed, with a view of showing the best methods of procedur: 
of the skilled writers. The effects of this analysis were (1) t 
make the teacher conscious of the factors in good methods o/ 
writing, and (2), as a result of (1), to devote herself more ¢ 
the process of children’s writing rather than the product. 

Let me give an illustration to show how we attempted to me 
the needs of the individual children in the supervised group. On 
of the boys chose as his subject “Mischievous Billy.” Although 
he had been taught how to make an outline, there was nothing 
in his outline to indicate what he planned to say. When asked 
he said, “I am going to tell how Billy went up town and a lady 
asked him, ‘How do you do Billy,’ and Billy said, ‘I do as | 
please.’ When the writer objected that this would not do, the 
boy said that he did not know what else to write. When asked 
he replied that he had had no one in mind when he chose his 
subject. 

Further questioning brought out the fact that there was «4 
little boy in his neighborhood, who might well be called ‘Mis- 
chievous Billy.” This little fellow had visited the yard of th« 
pupil where he had found a coaster wagon and a can of paint; 
he had proceeded to paint the wagon and had gotten considerable 
paint on himself. The boy was asked whether he knew another 
escapade of this little fellow. It happened that this small boy 
had had some difficulty with children in an adjoining block. The 
older children took up the fight and punished him by throwing « 
basin of water on him. The pupil agreed that this would mak« 
another good incident for a story about Mischievous Billy. He 
was then led to recall an incident in which he and his brother 
were the actors, an incident that might well be added to this story 
These two boys had a bantam rooster, a rather troublesome anima! 
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hour was given them in which to prepare and write their papers. 
The pupils were permitted to choose their subjects in advance | 
the day on which the final test was written. This was done in 
order to give them a better opportunity to plan their compositio: 
but there was little evidence that the children availed themselves 
of this opportunity. When the papers had been written, they 
were numbered according to a scheme which concealed the iden- 
tity of the writers. The papers of the supervised group were 
collected with those of the unsupervised group and rated with 
the Thorndike-Hillegas scale by the staff teacher and the writer 
The scores assigned the papers by the two readers were in rather 
close agreement. Thus in the final set, there was complete agree- 
ment in twenty-three out of thirty-three cases, one of the chil- 
dren of the supervised group having dropped out during the 
spring. In the remaining cases, the differences ranged from three 
to five points. For the purpose of computing the progress of chil- 
dren averages of the scores of the two readers were used only, 
and as the final scores, the average scores for the two final tests 
were used. 


THe RESULTS OF THE EXPERIMENT 


Do children profit from supervised study in English compo- 
sition, when the teachers know what to do with children during 
the supervised study period in order to improve their methods 
of work? Table I furnishes an answer to this question. Ac- 
cording to this table, the median gain for the supervised group 
is eight percent upon the initial ability as indicated by the scores 
from the preliminary tests, with a median deviation of 6.5. The 
median gain of the unsupervised group is three percent and the 
median deviation 6.62. This result is strikingly different from 
that obtained by Breed, who registers a loss for the supervised 
groups in English composition. 

When we come to our second question, do children of 
superior ability profit less from supervised study or actually lose 
as a result of it, we find the answer in Table II. 
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\BLE I.—PERCENT GAIN OF EACH PUPIL OF THE SUPERVISED AND 
THE UNSUPERVISED GROUP FROM THE PRELIMINARY TESTS TO 
THE FINAL TESTS. SCORED BY THE THORNDIKE 
HILLEGAS SCALE 


SUPERVISED GROUP UNSUPERVISED GROUP 
Number Coefficient Cais Number! Coefficient 
of of tia of ot Gaun 
Pupil Brightness perenne Pupil Brightness percent 
S17 122 21.8 16 QU 10 4 
S22 114 19.9 29 122 12.8 
S-3 109 17.1 6 RS Rg 9 
S-5 SY 14.8 15 101 S 0 
S19 104 10 9 25 Of 7.8 
$20 140 10 3 3 107 ” 4 
S 7 113 | 9.9 30 So “60 
S26 98 9.1 4 97 39 
S13. | 100 7.0 2 93 3.0 
S28 98 6.2 12 103 7a 
S10 SS 45 9 115 00 
S31 | v2 | 2.6 32 110 0.0 
$33 102 | -3.0 34 113 0.7 
S14 97 4 0 l RO 6 8 
$21 91 § 2 IS g9 7 6 
S 8 110 | —§ 5 11 S83 0 1 
24 118 16 

Median Gain... 8.0 Median Gain 3.0 
Average Gain. aa 7 Average Gain 2 6 
Median Deviation. . 6.5 Median Deviation 6.6 


In Table II the pupils ranking above and below the median 
in capacity as indicated by coefficient of brightness in each group 
are compared with reference to improvement made. Here we 
find that the bright members of the supervised group attained 
an improvement of 4.8 percent as compared with 1.66 percent 
for the corresponding numbers of the unsupervised group. The 
slower members of the supervised group achieved an improve- 
ment of 4.27 percent while the corresponding unsupervised group 
improved 2.72 percent. 

If we take initial attainment as the basis of comparison, we 
find that the fifty percent of the supervised group making the 
best average scores in the tests improved 3.65 percent, while 


the corresponding fifty percent of the unsupervised group im- 
proved but .16 percent. The remaining half of the supervised 
group gained 10.37 percent, while the corresponding half of the 
unsupervised group gained 4.6 percent. 











elt 
owl 


TABLE 


Lower Fiery 


- 


Upper Furry 


Lower Furry 





PERCENT BASED UPON COEFFICIENT OF BRIGHTNESS 


“UPEI 


Number 


JOURNAL EDUCATIONAL RESEARCH 


t‘VISED GROUP 


Coefficient Cain 








Vol. 5, N 








Il.—SHOWING GAIN PERCENT OF UPPER AND LOWER 


UNSUPERVISED Grovr 
Number Coefficient 


Gain 
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ot of INT j of ot 
Pupil srightness — Pupil Brightness pare 
S17 122 21.8 29°C 12200~CO| CoS 
S22 114 19. 9 15 101 8 0 
S23 109 17.1 I 107 7.4 
2 S19 104 09 |} 12 | 103 2.1 
= S20 140 | 103 9 | 115 0 
a S7@ 113 a9 | #82 110 0) 
833 102 3.0 I 34 | 113 7 
SS 110 S5 24 118 16 3 
\verage gain is Average gain 1 th 
sO5 su 14.8 16 99 10 4 
S25 OS y | 6 SS su 
e SIS 100 760 8 BI 8 7.8 
= S28 oS 6.2 300 | 83 6.0 
= S10 SS 5 1 | 97 3.2 
Ss S3l 2 2.6 l | SO 68 
Sl4 97 —4.0 IS a9 7.6 
S21 o] 6.2 11 ' 83 9 1 
Avernge gain $27 Average gain 2.72 
ILE I11.—COMPARING RATE OF PROGRESS OF CHILDREN ABOVE 
MEDIAN IN SCORES OF PRELIMINARY TESTS WITH 
THOSE BELOW MEDIAN 
SUPERVISED Group UNSUPERVISED Group 
Number | Aver- | Coefficient | Gain || Number} Aver- |Coethcrent | Gain 
of age of | Per- of |} age | oO | Per- 
Pupil Score | Brightness | cent Pupil | Seore | Brightness | cent 
SSI OS 92 2.6 || 24 72 |} WS § -+-163 
_ §20 65 140 10.3 |} 29 66 122 12.8 
> 88 65 110 —-SEH 16 65 | a9 -76 
2 S13 61 100 | 7.0] 4 63 | 97 3.2 
= S28 il OS | 6.2 34 2 113 7 
= Si4 61 97 -40]] 25 | Ol | 96 78 
S21 60 91 I- 6.2 12 61 | 103 2.1 
S17 59 122 | 21.8 || 9 | 60 115 0 
Average Gain 3.65)) Average Gain 0 
S33 OS 102 30}) 32 | 60 110 0 
S10 55 8 | 45 2 | 58 93 3 
» S26 55 9s | 91] 6 56 88 89 
4% S19 55 | 104 109 1 | 655 83 91 
2 S22 54 | o114 | 19.9 || 15 | 53 101 s 
am S23 51 | 109 17.1 | 16 8 26| (351 99 19 4 
= $7 5I 13 «| 99 | 3 | Si | 107 74 
S85 49 89 {14.8} 1 51 86 -68 
| 30 | 4 | 83 | 6 
\verage Gain 10.37)| Average Gain | 46 
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Table III comes nearest to supporting the inferences of 
ous investigators of this problem: Le., children with high 
‘tial attainments under supervised study organization show but 
ttle improvement while those of low initial attainments show 

tively high gains. But even these tables do not show actual 
es for the supervised bright child and high gains for the 
nsupervised bright child. Is it possible that children in former 

nvestigations of the efficiency of supervised study were using a 
ver amount of time for their work than those of the super- 
sed groups? Is it further possible that they received assistance 

n their homes which really made the work of the unsupervised 
roups supervised work? This experiment was controlled in 
rder to prevent the assistance which children might receive in 
heir homes and their use of mere time for their tasks than the 
upervised group. 

These takles also point out another possible difficulty with 
previous experiments. The gain or loss in these tables is based 
upon the score which children made in the preliminary tests, upon 
ability in the subject in which rate of progress was to be meas- 
ured. Is it possible that the actual attainments in a given subject 
have been mistaken for capacity for achievement in that subject ? 
By actual attainments, as indicated by the preliminary tests, seven 
out of sixteen children were misplaced, that is, they were classed 
with the pupils of low capacity when they should have been 
ranked with the superior. The pupils in question are Numbers 
33, 19, 22, 23, 7, 15 and 3. It is of course possible that English 
composition is peculiar in this respect, that capacity correlates less 
closely with actual attainment than in other school subjects. Thus 
in the above group there were at least four boys who, while very 
capable in many lines, were not interested in writing compositions. 
lt may also be objected that an intelligence test is not an abso 
lutely sure indication of the intelligence of the pupils tested. This 
objection, however, would not hold in the present case, for in 
passing upon the validity of the division made there were avail- 
able the results of other tests previously given and the teachers’ 
estimates of the children’s ability. The division into two groups, 
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therefore, was probably as accurately made as possible. It would 
seem, therefore, that this is a point which requires attention in 
future investigations involving the division of classes into groups 
of equal capacity. 


SUMMARY 


Our results seem to indicate that carefully directed study or 
work of children in writing compositions is decidedly valuable 
to children receiving such supervision. 

The results of this investigation further indicate that under 
fairly skillful direction the brighter children of a supervised class 
not only make better progress than the brighter members of equal 
ability of the unsupervised group but that they also make better 
progress than the slower children of the supervised group. 

The experiment seems to show that the methods used in the 
direction of the supervised group had sufficient merit to lead to 
decided improvement of the supervised over the unsupervised 
group and to indicate further that the brighter members of the 
group were helped at least as successfully as the slower members 


CONCLUSIONS 


1. Supervised study in English composition is eminently 
worth while when teachers are able to direct children’s efforts 
intelligently. For this purpose they must know the technique of 
learning in this branch and apply such knowledge to the varying 
needs of the individual members of the class. 

2. While a knowledge of the various general factors of 
study is worth while, at least to the teacher, she must not stop 
there. Methods of work imply a large number of specific knowl- 
edges, habits, and attitudes which differ in the several fields of 
study and which must be acquired through successful comple- 
tion of specific tasks in each field. The pupil can acquire effective 
methods of work only by working with purpose and intelligence 
under a teacher who knows intimately the most successful 
methods of procedure. 
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: As in all teaching an intimate knowledge of children’s 


interest and experiences as well as capacities is absolutely essen- 
tial in directing their work. 

4. In the present stage of progress in the teaching of Eng- 
lish composition the writer believes that teachers of this subject 
would be greatly benefited if they had access to a case book 
describing how the needs of the various types of children can be 
best met. 
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SOME INDIVIDUAL DIFFICULTIES IN THE 
STUDY OF MUSIC 
EstHer ALLEN Gaw, Pu.D 
San Francisco State Ne l Sel 
One of the requirements of the Board of Education in Cali- 
nia is that every teacher shall be able to teach the music of the 
to which she is assigned. She must, therefore, be able to 
the songs of the “Progressive Series,” which is the prescribed 
k, and to read at sight readily enough to teach any other 


es that may be needed. She must understand the technique 
ur music system, that is, the keys and their relationships and 
staff notation. 

In order to teach the staff, the keys, and the relationships of 

svilables, the music department of the San Francisco State 
Normal School uses a series of bulletins which outline the mini- 

m requirements. These are arranged in three units upon each 
ne of which the student passes an examination. These units 

as follows: 

The student must be able t sing and w rite the scales of 

e tonic chord, in the keys of e-flat and f-major, getting the 

pitt h from the pitch-pipe. These key s are used because they are 
within the staff and are pitched where the children sing. 

2. The student must be able to sing at sight each measure 
f an exercise or song in 4-4, 3-4, or 6-8 time, with one sound 
»a beat, one sound to two beats, one sound to three beats, one 
sound to four beats, two equal sounds to one beat, and, in the 
case of 6-8 time, one sound to five or six beats using the keys 
and intervals studied in 1. 

3. The student must be able to recognize and sing at sight 
skips of thirds, fourths, and fifths in the same two keys, and 
to apply them in the songs of Book 1, and also to pass a sight 
reading examination in an unknown song involving only these 
problems, 

This is the outline of the course in music which must be mas 
tered by any student before she is allowed to teach the simple 
primary songs. 
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In the fall of 1920 a survey of the students in the San Fran- 
cisco State Normal School produced the fact that there were 
twenty-four who were conspicuously unsuccessful in their study 
of the music course after having carried it for three months. 
These students were not able to sing the songs alone either at 
sight when presented on the written page, or in true intonation. 
In order to determine whether or not the difficulty was one of 
inability to hear the tone differences which they could not pro- 
duce, they were given the four sensory discrimination tests and 
the tonal memory test which have been recorded on the phono- 
graph by Seashore. 

The Seashore tests do not need a detailed description here. 
Suffice it to say that there is a test for pitch discrimination, one 
for intensity discrimination, one for the discrimination of dura- 
tion of time intervals, one for the discrimination of the relative 
consonance of musical tones, and, finally, a test for immediate 
memory span for a series of nonsense musical tones.’ These 
tests have been standardized and norms of percentile rank are 
published in the Manual. 

To return to our students who are trying to learn to sing. 
The supervisor asks, “What is the cause of this inability to learn 
elementary music? Is it a general cause, or are there differences 
in their native capacity which make music so difficult for them 
to grasp; and how can I help each one most effectively ?” 

Before the tests were given, the twenty-four girls were 
sorted into three groups: (1) Six students of whom there was 
some hope that slowly and gradually they might come up to the 
required standard. These were called “hopeful.” (2) Six stu- 
dents of whom the supervisor was in grave doubt, but of whom 
she still entertained a hope that by unusual diligence they might 
reach the standard. These were called “doubtful.” (3) Twelve 
students who, the supervisor felt, gave unmistakable evidences of 
never being able to meet the required standard. These were 
called “hopeless.” This ranking was done by the supervisor, 


*Seashore, Psychology of Musical Talent, Silver, Burdett & Co. See 
also Manual of Instructions and Interpretations for Measures of Musical 
Talent, Columbia Graphophone Co., New York. 
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entirely independent of the psychologist, and purely upon her 
observation of the actual achievement of the students, but in the 


light of her teaching experience. 


Table I shows the percentile ranks of the twenty-four stu- 


dents according to the Seashore tests. 


In percentile ranking the 


highest possible mark is 100, the lowest is 1, and the median is 


cQ. 


An average of percentile ranks does not have any particular 


significance, since the tests are of different values in diagnosis, 
but it is desirable to have some general designation of the indi- 


vidual record as a whole. 


For the purpose of grouping I have 


called the records which on the average fall between 1 and 15 
in rank, very inferior; those from 16 to 30 inferior; those from 
31 to 47 fair; and those above 48 good.? 


TABLE I1.—PERCENTILE RANKS ACCORDING TO THE 
SEASHORE TESTS 








STUDENT'S 
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74 Survey of Musical Talent in the Des Moines Public Schools, Child 
Welfare Research Station, Univ. of Iowa, 1920. 
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When it is understood that the rating hopeful, doubtful, and 
hopeless was independent of the sensory tests, and when the 
rank of the students in each category is studied, a distinct corre- 
lation is immediately perceived. This is more fully brought out 
in Table II. In this table the divisions good, fair, inferior, and 
very inferior are based upon the general results of the fi: 


TABLE I1.—RELATION BETWEEN SUPERVISORS’ JUDGMENTS ANI 
RATINGS ACCORDING TO THE SEASHORE TESTS 


. ; CLASSIFICATION ACCORDING TO SEASHORE ‘TEsTs 
SUPERVISOR 8 - -- . a8 es 


CLASSIFICATION Rs A | Inferior Fair | Good 
Hopeful ' ; cal 0 0 | 2 } 
Doubtful. . anol 1 3 a 0 
Hopeless : : | 6 3 3 0 


measurements of each individual. The divisions hopeful, doubt 
ful, and hopeless are the empirical classifications of the supervisor 
The figures in the spaces indicate the number of individuals under 
each of the double classifications. It is apparent that those who 
are hopeful are the highest in their sensory capacity, that those 
who are doubtful fall a little lower, and that those who are 
hopeless are undoubtedly the lowest in the sensory measurements. 

I shall describe in detail a few of the cases. Each one is 
interesting and significant, but I shall limit my descriptions to a 
few of the more dramatic ones. I shall refer to them by the 
numbers used in Table I. 

The supervisor's comment on No. 1 in September was that 
she had no experience and was very timid. It was this timidity 
that made me feel that the results of the first group tests were 
probably unreliable, and I tested her again with the results given 
in the table. Three months later the supervisor reported that 
while she was not especially strong in music and was very lack- 
ing in self-confidence, she was slowly learning the required songs 
and would be able to teach the simple songs at least. The student 
herself reports that when she learns the songs with the syllables 
she cannot then transfer the words to the melody and, therefore, 
is very slow in learning the material. The process demanded 
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the teachers (that of first learning the syllables) which is a 
Ip to many, is a hindrance to her. Her motor coordinations are 
rsistently inflexible with this resultant difficulty. She also has 
distinct sensory inferiority, since she does not remember tones, 

such, as well as the majority of normal people do. These two 
eaknesses, in connection with a lack of self-confidence, will 
ike her slow, but there is no reason why she cannot ultimately 
rn the music required. 

No. 2 isa case of another timid soul who does not show her 
ue capacity at first. In September the supervisor reported that 
e could not sing a melody alone. Three months later she re- 

ported that she was singing with great timidity and getting her 
work very slowly, but that she was able to sing the simple pri- 
mary songs with an accurate voice of pleasing quality. It is 
ta sensory difficulty, then, as the tests show, nor a motor diffi- 


culty, as the accuracy of her singing shows, but a temperamental 
lifficulty; and she is, therefore, properly classified as “hopeful.” 


No. 8 was found to be fair in her sensory capacity. The 


/ 


upervisor said: “Her voice flats; she cannot remain true.” 
Three months later, although the student had been working faith- 
fully at her music, the same report was made. In the supervisor's 
words: “Her voice flats very markedly; she goes quite off and 
it is a surprise to her that she isn’t doing it correctly. She only 
approximates a tune. She can read and is trying hard to finish 
her music. If she could retain the pitch, she would be all right.” 
No. 8 1s one in whom the sensory capacity is not the important 
weakness; her difficulty is in motor capacity. There are people 
who can see a ball and who can hold a tennis racquet, but who 
have great difficulty in learning to hit the one with the other. In 
the same way there are those who hear the pitch of tones and 
who can use their voices for ordinary purposes, but who cannot 
hit the pitch of the tones accurately with their voices. No. 8 is 
an illustration of this kind of motor difficulty. She will have to 
take very intensive practice in gauging the pitch distances which 
her voice must control; and by such drill alone will she be able 
to improve the accuracy of her singing. 
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No. 10 was reported in September as having no musica! 
experience. Three months later the supervisor said of her, “She 
appears to have no conception of what reading means. She 
doesn’t look at the right place in the book. She can imitate tones 
but seems to have no power to concentrate on the problem of 
reading.”” With her inferior rank in the sensory tests she probh- 
ably cannot remember the tones for any length of time. She 
may have no particular weakness in motor capacity, but if, i; 
addition to her inability to learn to read the notes, she is further 
handicapped by inferiority in intelligence, she will probably never 
be able to do even the minimum in music. 

No. 15 was reported as being weak in music, but the super- 
visor was not sure whether this was due to lack of previous ex- 
perience or to natural incapacity. Three months later the super- 
visor had found that No. 15 could not yet sing a melody and had 
very little conception as to whether or not she was singing cor- 
rectly. She displays fair sensory capacity but is probably lacking 
in motor control and coordination. She is very intelligent and 
could undoubtedly improve her motor attack to some extent. 

No. 17 was simply reported as being weak in music. Later 
the supervisor noted that if she worked on a tune long enough, 
she got it but not with perfect accuracy. Another supervisor 
asked her in my presence to sing a tiny melody of four tones 
not more than a step apart. She made three attempts but went 
in the wrong direction on each trial. The tests show that she is 
distinctly inferior in her sensory capacity, and she is also evi- 
dently inferior in her motor capacity. Whatever she learns to 
sing will be acquired slowly and with great difficulty and wil! 
never be accurately retained. She loves, however, to listen to 
music and works diligently at it, although she knows that she 
is accomplishing very little. 

No. 22 was reported as having no previous knowledge of 
music. Three months later the supervisor’s report says, “She 
sings down when the notes go up, and vice versa. Time values 
she also cannot comprehend, although she has had special train- 
ing in a small class. A song that she once learns, largely by 
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hearing it, she can sing.” Here isa case of very inferior sensory 
capacity linked with inferior intelligence which means that she 
will learn even the minimum amount of music only by the great- 
est expenditure of effort on her part and specially adapted train- 
ing on the part of her teachers. 

From these briefly described cases some general observations 
may be made. Difficulties in learning music are of at least two 
distinct kinds; there are sensory weaknesses and there are motor 
weaknesses. Each may exist in an individual by itself or in 
connection with the other. Either one alone puts the possessor 
into the class of those who learn music slowly, painstakingly, and 
—often in the end after much effort—ineffectively. If to these 
weaknesses is added slowness in general intelligence the situation 
becomes even more difficult. Those who are found to be of 
either or all of these three classes must be trained individually 
by methods specially adapted to the particular case. 

At the San Francisco State Normal School an effort is being 
made to give special training to these students. The work is 
yet in the experimental stage, so that I cannot describe any final 
results. The students who were graded as hopeless have been 
grouped together into a special class, where they are taught to 
sing some simple primary songs together by note. These they 
sing with haziness of intonation but with a rather surprising 
approximation to the pitch. When each student sings alone, she 
is not at all sure of herself. The quality or timbre of their 
singing is very bad, and apparently they are very vague in a con- 
scious conception of what they are doing. By this I mean that 
they are not accurate in the beginning and ending of phrases or 
in the actual relationship of pitches. They rely upon their teacher 
and upon one another. I felt when I heard them sing in a group 
and individually as I do about a little child who is learning to 
walk. I admire his tottering efforts when I consider that he 
is a little child. But if I consider his achievement as walking 
I must admit that it is not a very successful performance. So 
I feel about these students who are deficient on the sensory or 
motor sides of their inborn equipment for music; it is surprising 
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that they can sing at all, propping themselves up on each ot! 
and leaning on their teacher, but as real singers they are very | 
The results of this study, reinforced by previous observati 
of similar cases, lead me to the belief that those who are we 
or inferior in hearing the characteristics of musical tones will | 
weak and slow in reproducing them. It would undoubted], 
more economical of effort, both on the part of the student and 
the teacher, if they could be released from the drudgery of t: 
ing to learn something which is so difficult, and could turn th 
energy and talents to a field where achievement would be n 
notable. But, since under the present circumstances we must 
train them as well as we can, we must reinforce their auditor 
motor weaknesses by artificial associations. For instance, 
tonoscope may be used to give a visual correction of faulty in 
tonation, or an artificial association of tones with colors may 
be deliberately used to improve tonal memory. Various synes 
thesias, according to the needs and capacities of each individual, 
may be worked out as crutches for the lame ducks in music. This 
immediate problem of forming artificial associations is a very 


interesting one on which I hope to be able to report later. 








INTELLIGENCE TESTS AND THE CLASSROOM 
TEACHER 
ArtTuur W. KALLom 


issistant Director of Educational Measurement, Boston, Massachusetts 


Tests, either intelligence or achievement, may be given for 

e reasons: (1) for the purpose of collecting data; (2) for 

purpose of satisfying the curiosity of the teacher; (3) for the 

pose of bringing a definite constructive help to the teacher in 
iding and aiding her in dealing with some of the problems with 
hich she is confronted. 

Up to the present, much of the work of educational measure- 
ent has been concerned with the first step. This 1s important. 
has made it possible to establish standards, it has confirmed 

he theories that the educational product is variable and not con- 
stant, it has emphasized and placed on a more or less scientific 

isis, perhaps, the greatest educational fact of the past genera- 
ion, namely, individual difference. There is still need for a great 
leal of work to be done along this line. This research work is 
the work of universities, foundations, and similar bodies and 
not the work of city departments, which are supported by public 
money. Their research work, per se, is a by-product. 

It isa good sign to see the teacher's curiosity aroused to know 
what her class will do with certain tests. Perhaps she has a sus- 
picion that Aer class will not show marked signs of individuality 
because her class was a selected group and because children of 

bout the same grade of ability were put together in her room. 

Therefore she is curious to see if some of the theories of the 
savants can not be exploded and is much surprised to find that 
there is, perhaps, as great variation in her room as in another 
room not so carefully selected. 

The teacher who is curious to know what will happen when a 
test 1s given should be greatly encouraged, because out of the 
“knowing” is going to come “doing.”” Out of the knowledge of 
where each pupil stands is going to come a better directed effort 
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to help those who need help, to drill those who need drilling, a: 
to guide those who need guiding. The efficient teacher is the o: 
who is accepting all the help which tests can give in promoting 
drilling, and guiding. Such a teacher makes it justifiable for a 
city school system to expend public money for a department 0; 
research. Directly or indirectly such a department makes 
possible for the taxpayer’s son and daughter to be better and 
more efficiently taught than before; better taught because bot! 
teacher and pupil have a definite aim toward which to press, ; 
more efficiently taught because the teacher with a more direct 
knowledge of what the child is able to do can save valuable tiny 


INTELLIGENCE TESTS 

During the past few years intelligence tests have held a prov 
inent place in the testing program of departments of research and 
of all up-to-date superintendents. Such tests are fraught wit 
a good deal of difficulty unless one is careful how the results ar 
used and unless the one in charge realizes the limitations of suc! 
a test. Two cases will ‘lustrate what I mean. 

In a certain city one of the well-known group intelligenc: 
tests was used and a certain pupil scored low. The score was so 
low that the pupil was judged feeble-minded by the principal, and 
the parents were asked to withdraw the pupil from the schoo! 
The parents objected, and when he was tested by a competent 
person, using the Binet-Simon scale, the boy showed an intelll- 
gence quotient of 123. 

The second case was a girl in one of our Boston schools wh 
tested low with the National Intelligence Test but who was 
judged one of the brightest children in the school by the teachers 
The possibility of such a condition was admitted, but an indi- 
vidual test was given. The girl showed an I. Q. of 115. It was 
found upon investigation that, on the morning the group tests 
were given the girl had come from home after witnessing a braw! 
between her father and mother in which she was obliged to take 
some part. She had had no breakfast and had taken the test 
within half an hour after arriving at school. 
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INTELLIGENCE Tests Arp IN GuipING Puptits to CH 


OF COURSES 


Children entering the seventh grade in any Boston 
mediate school, may choose to take a modern foreign lang 
either French, Spanish, Italian, or German. Each school 
have only one foreign language, however. Because this m 
foreign language is an extra subject, only those children a: 
lowed to take it, whose marks are equivalent to an average oi 

Of 51 children in one school who were tested in the 
grade and placed in French classes, 25 percent had a sco: 
less than 109, the median of the sixth grade. Of this 25 per 
39 percent made good, but in every instance effort and cor 
vere excellent. Of the 75 percent who were above the med 
only 2 persons or 4 percent failed. One of these had an efi 
of E and a conduct of D. This school ts typical of all int 
mediate schools 

Therefore, for a pupil who scores below the median 
chances of success with a program which requires an extra an 
of work are about twe chances out of five, and then only 
cause effort and conduct are excellent. When the pupil's 
reaches 120, the chances of success amount almost to certaint) 

When children enter high school they are required to 

definite course which may lead to a college, technical scl 

normal school, or business. In many cases children desire to t 
a college course, who are totally unfitted either to profit by 


a course or to handle the necessary preparatory work. S$ 


children are not warranted in spending their time either in his 
school preparing for college, or in college, providing they bare! 
reach the minimum requirements for entrance. 

Making a careful study of the relation between the scor« 
an intelligence test and the marks obtained by an individual 
his high-school work, will enable us to prophesy the chan 


which the individual may have to complete his high-school w: 


successfully. 
Table I shows that Pupil No. 1 is 14 years 8 months old. 
the Binet-Simon Test he showed an intelligence quotient of 99 
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f the educational pr infitted to do tl 
means the organizing of a suitable program for those wl 
he present curriculum ill-adapted to their particular needs 
determining this mental ability, an important question aris 


carding the extent to which it is wise to go 1n our different 


INTELLIGENCE Tests Aip IN ADVANCING DEMOTED PuP! 
Many children are obliged to repeat a year on the bas 
teachers’ marks. It is known that teachers’ marks are to a 
extent unreliable. This results sometimes, in requiring child: 
to repeat a year’s work, who are mentally capable of doin 
work of the next grade. 
In testing certain classes early in September, 1920, the po 

class in a certain building was easily identified, and it was int 
esting to find that this poorest class was composed of sever 


grade pupils who had not been promoted. Of the 33 chil 
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FIGURE I.—SIXTH GRADE SEATING PLAN SHOWING PUPILS’ INTE! 
LICENCE QUOTIENTS 


cases, however, the language of the home is Yiddish, be 
the mother rarely speaks English. The numbers placed in 
small rectangles represent intelligence quotients based 
Stanford Revision, all children having been tested either by 
author or under his direction. It will be noted that the intel! 
gence quotients range from 61 to 164. 

The teacher of this r Om iS, therefore, obliged to tact 
day children ranging all the way from superior mentality t 
mental condition which borders on, if it is not actually equal t 


that of a high-grade moron. She is expected by principals and 


other supervisory officers to prepare these individuals for pr 
motion to Grade VII, with the expectation that after they | 
been promoted to Grade VII they will be able to do the work o1 


that grade. The intelligence test often shows the utter im 


sibility of any teacher's doing the work that is expected of het 


Figure 2 shows the same schoolroom tested with the Thor 


dike-McCall Reading Test. The numbers in the small rectangles 
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SCALES FOR MEASURING RESULTS OF PHYSICS 
TEACHING 
Harouip L. CAMP 
University of Illinois 


Those who are familiar with the teaching of high-sch 
physics realize the need of scientific investigation to aid in sol\ 
ing a number of vital questions. The following are some of tl 
most significant of these. To get the results sought, how muc! 
time should be spent in performing laboratory experiments? | 
the results of laboratory work justify the expense involved 
furnishing several sets of equipment? How should the time { 
the study of high-school physics be distributed as to: work 
the laboratory, learning the fundamental principles, solvir 
problems, recitations, and observation of class-room demonstra 
tions? How may the course of study be revised to meet m 
fully the needs of the majority? 

In attempting to solve some of these problems one ts cor 
fronted with the need of suitable tests or scales with which 
measure physics ability or achievement. If we have suc! 
measuring instruments we may by varying the time devoted 
laboratory experiments ascertain the resulting degrees of pr 
ress. Similarly, the relative advantages of single and dup! 
cate sets of apparatus, of different combinations of laboratory 
work, observation, problem solving, etc., and of various oth 
devices and pre cedures may be determined through the achiev: 
ment of the pupils. 

Few outstanding contributions have been made to the field 
high-school physics testing. Starch’ arranged 75 mutilated ser 
tences involving 102 fundamental principles treated by five most 

commonly used textbooks; but he did not give the relative diff 


culties of these 75 test exercises. Chapman* reported the per- 


*Starch, Daniel, Educational Measurements. New York: The Maemillar 
Company, 1916. pp. 188ff. 


*Chapman, J. C. ‘*‘The Measurement of Physics Information,’’ Sch: 


Review, 27: 748-56, December, 1919. 
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“What is the density of a block of wood that floats 34 under 
water?” 

“What is the possible buoyant force of 78 pounds of cork 
whose density is 15.6 when water weighs 62.4 pounds per cubic 
foot?” 























In selecting the exercises the following requirements we: 
used as a guide: (1) The test exercise must apply specificall) 
to the field of knowledge to which the test is related. (2) It 
must be taken from an essential part of the subject, a part whic! 
is contributory to understanding or summarizing a general theor 
or principle ; in other words, it should be such that a correct 
answer would indicate that a distinct meaning had been grasped 
(3) It must be so worded as not to be ambiguous. (4) It must 
be so framed that it can be answered very concisely, usually by 
a single word, or at most by a short phrase. (5) It must lx 
such that the short answer given in the test includes all possibl 
correct answers. 

The exercises were arranged in 47 different preliminary tests 
of nine or ten exercises each. The correct solutions of these 
exercises were attempted by approximately 3500 boys and girls 
in 129 of the best high schools in Iowa. Each test was dis 
tributed over the state so that the pupil-reactions on the exercises 
included in it would be representative of the state as a whole 
On the average each exercise was attempted by 99 different 
pupils (minimum 60); and each test was given from eight t 
ten weeks after the work in the field to which it applied had been 
finished. 

The Probable Error method was used in evaluating the exer 
cises. The results, shown by a statistical treatment of the data 
gathered, justify the fundamental assumption of this method, 
namely that the distribution of physics abilities conforms approx! 
mately to the Normal Probability Curve of Distribution. An 
exercise so easy that only I in 10,000 would fail to solve it cor- 
rectly was assumed as an exercise of zero-difficulty. Its position 
on a linear scale of difficulty is at —6 P. E. or about (—4 sigma) : 
and all the test exercises finally used in the scales were assigned 
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2. From the following select a good conductor of heat: wood. 
stone, air, copper, water, vacuum, iron. (value 6.3) 

3- What is the common name for the action which takes plac: 
when an iron ball is warmed from 1o degrees C. to 
degrees C.? (value 6.9) 

4. At ordinary atmospheric pressure ice melts at o degrees C.; 
to make ice melt at 2 degrees C. would we increase or 
decrease the pre ssure? (value 7.8) 

s. What is the common name of the process by which heat is 
carried from one place to another by a moving fluid? 
(value 8.5) 


ELECTRICITY AND MAGNETISM 

1. From the following select one which is a poor conductor of 
electricity: graphite, glass, hard rubber, pure water, paper 
(value 3.6) 

2. What is the common name of the electro-motive force needed 

to drive a current of one ampere through a resistance of 

one ohm? (value 5.7) 

Will positive electrification attract negative clectrification ? 

(value 6.3) 

4. With what kind of a cell should the circuit be kept open when 
not in use? (value 7.8) 

5. What kind of positive and negative static electricity 1s 
formed on a conductor in the neighborhood of a charge? 
(value 8.7) 


ow) 











Table I shows the tentative norms on Form I of each test fo: 
bovs and girls in Iowa high schools. 
TABLE I.—TENTATIVE NORMS (FORM I) 
Mep1 AN Score | INTER-QUARTILE R ANGE 
| Boys | Girls Total | Boys Girls Total* 
Mecuanics. ..| 39.5 | 30.6 | 33.5 | 24.6—53.3 | 18.4—44.3 | 21.0—49 0 
Heat - 44.4) 40.1) 41.9 29. 9—58.1 | 25.8—53.1 | 27.4—55.1 
ELECTRICITY 
AND | 
MAGNETISM 46.3 | 36.5 | 39.9 | 33.2—61.8 | 25.5—149.3 | 28.0—54 6 





* Total refers to both boys and girls. 


The three scales and the tests available therefrom, when prop- 
erly selected, administered, and scored, should prove to be of 
considerable value: (1) to the experimenter, as a means of com- 
paring the results of two or more methods of teaching the same 
subject matter; (2) to the college or university, as a part of 




















CONVENIENCE AND UNIFORMITY IN REPORTING 
NORMS FOR SCHOOL TESTS 
J. Crospy CHAPMAN 
Yale University 

The desirability of securing some uniform procedure for scal 
ing the achievements of pupils in school tests is evidenced by th: 
recent attempts and suggestions which have been made by several 
authors. Reference may be made to the work of McCall, 
Pintner,* Buckingham,* and Buckingham and Monroe.* Thes 
very recent papers indicate the extent to which trained workers 
in this field realize the necessity for some definite conventions 
For the larger number of individuals without much training, wl 
are using these tests in practical work, there is even more neces- 
sity for definite agreement. An association such as this journal 
represents could hardly fulfil its function better than in furthering 
this attempt to secure uniformity and order, in a situation which 
as it now exists is chaotic. 

At present a score of twelve in one test means the same level 
of achievement as fifteen, thirty-five, or seventy-one in another 
test. Even after we have transmuted from the crude scores t 
equivalent scores, there is again no uniformity. <A score of fifty 
may mean the median achievement of unselected twelve-year-olds, 
as in McCall's plan, or the median achievement of an unselected 
group of any age as in Pintner’s procedure, or the achievement 
of a particular mental age as in the method of Monroe and 
Buckingham. 

We must work for an agreement whereby after the transition 
has been made from the crude score to the equivalent score, the 
latter will have an obvious meaning. This meaning must be 


1McCall, William A. ‘‘A uniform method of scale construction,’’ Teachers 
College Record, 22: 31-51, January, 1921. 

? Pintner, Rudolf and Marshall, Helen. ‘‘A combined mental-educational 
survey,’’ Journal of Educational Psychology, 12: 32-43, January, 1921. 

* Buckingham, B. R. ‘‘Suggestions for procedure following a testing pri 
gram,’’ Journal of Educational Research, 2: 787-801, December, 1920. 

* Buckingham, B. R. and Monroe, Walter S. Illinois Examination, Teach 
ers Handbook, 1920. 
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such an assumption may well be true for tests which are ver 
carefully constructed, and for tests which measure some skill su 
as reading ability by material which 1s easy for the lowest ag 
population considered, it is more than doubtful whether 
assumption holds for tests which are less carefully assembh! 
and for tests which measure informational material rather tha: 
some basic skill of steady growth. 

(3) There will be a natural tendency on the part of the casual 
user of tests so standardized to assume, for a particular grow 
other than twelve-year-olds, that forty on the scale for one test 
is really the equivalent for that group of forty on the scale for 
any other test. Great practical advantages would be derived 
from any scheme so constructed that, for any particular group 
considered, a score of forty would mean the same level, wit! 
respect to that group, in any test, just as in McCall's scale a scor: 
of fifty or any other score means the same, for the twelve-year 
old population, in every test. Owing, however, to the differences 
in overlapping of any two groups in different tests a score of 
forty on his scale in one test would be attained by x percent of 
a particular population, other than twelve-year-old, while th 
same score in another test would be attained by a quite different 
percent. Thus while a scale score of ft units means the same, 
irrespective of the test, for twelve-vyear-olds, it would not hay: 
the same meaning for any other population. 

(4) There seems something incongruous in standardizing 
tests, covering material taught in Grade VIII or VII, on a popu- 
lation of which a considerable portion has not been subject t 
instruction. This point will be returned to later. 

(5) There is the less academic but more practical question 
as to whether the school people who give the tests are not more 
interested in thinking in terms of grades, that is in placing a child 
in a particular group, than in discerning his position on a scal 
calibrated with an unselected group of twelve-year-old pupils 
Usually the question is one of promotion, or transfer to some 
other group. Where the thinking is done in terms of grades 
there is a great advantage in having the median and other per- 
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as though in a cold country where there are no thermome: 
standards we should attempt with elaborate minuteness to sta; 
ardize the points on our scale by taking at a particular peri 
time the average temperatures of a large number of dwelling 
simultaneously starting a movement, with the help of the s 
thus standardized, to raise the average temperature of the hous 
The more effective the movement and the more our scale hasten 
the change, the more impossible it would be to maintain anything 
more than a rough standard of temperature. To select our hou 
too carefully or to spend much time in calibrating our instrument 
by such a criterion would obviously be absurd. Now this is t 
exact state of affairs with certain of the scales. Thorndike « 
McCall recommend their reading scales as devices for improving 
the objective product; yet it is by this product, a changing fact 
that they propose to standardize the scale. For rough estimates 
no doubt this procedure is justifiable, but it shows how easily t 
much time may be spent in elaborate standardization. All this 
is pertinent to the question as to whether an age group which : 
difficult to procure, furnishes a sufficient amount of increased 
stability to justify its use. 
There is of course no need, when considering the relatiy: 
merits of age groups and grade groups, to decide exclusivel) 
the favor of one or the other. Both are essential. This paper 
makes the plea that, all things considered, the grade group is not 
only more convenient but also more significant in school practic 
and school thinking. Age groups will, however, have to be us 
for many purposes and, suggestions are later made for a untforr 
scheme of presenting results for such groups, similar to that sug 
gested for grade groups. For example, in the matter of intelli- 
gence we have every right to think in age groups. Probably t 
best procedure is to place a child in each age group, and make 1 
attempt to refer him to groups that have had more or less years 
of environmental experience. Any such comparison ts perilous 
at best. This point is taken up at fuller length in an experimental 
study on “A Further Criterion for the Selection of Mental Test 


Elements.” 


* An article to appear in the Journal of Educational Psychology, May, 12 
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It is quite apparent that if the passage is to be made trom 
crude scores to achievement quotients, based on mental age, one 
must work with age groups. Such passage will, however, if it ts 

be at all reliable, necessitate very accurate instruments which 

easure very specifically the two factors involved, namely school 
achievement and mental achievement. The present attempts in 
this ambitious direction, involving as they do all the errors char- 
acteristic of both types of measurement must be taken cium grano 
sulis. Especially is this true when the very tests by which we 

easure school efficiency are themselves being used with satis- 
factory results by other experimenters, to measure the other 
variable—namely, intelligence itself. Thus, for example, the 
National Intelligence Test employs a fundamentals test as a 
measure of intelligence. Pintner‘ using a non-linguistic test 1s 
less subject to criticism than Monroe and Buckingham; but a 
careful consideration of the inaccuracy of the two measurements, 
intelligence and school achievement, together with the fact that 
we are certainly measuring to no small degree the same factors, 
should make us very careful in interpreting such results at their 
face value, for the individual pupil. 

The same criticism regarding reliability applies to the work 
of Monroe and Buckingham in the Illinois Examination. Here 
crude scores are transmuted into achievement ages, from which 
they pass to achievement quotients. To overcome the difficulty 
that the high scoring pupils in the higher grades score more 
points than the norms for thirteen and fourteen years, the authors 
are compelled to resort to the hyp thetical achievements of age 
groups which cannot be obtained empirically. This extrapolation 
is carried almost to the limit when for a particular crude score in 
arithmetic we find on transmuting it into achievement age that 


it corresponds to a performance of 25-year-~ lds. 

* Pintner says that for 300 children, ranging from the third to the sixth 
grade a correlation of .47 was obtained between his mental index and the I. Q. 
on the Stanford-Binet. For the purposes for which he uses his indices, even 
allowing for the unsatisfactoriness of the Stanford-Binet as a perfect criterion, 
it seems hardly justifiable, considering the range of the group tested, to say, 
as he does, that such a relationship is ‘‘ very satisfactory.’’ If there is the 
same unreliability for the educational index the ratios must be exceedingly 
unreliable. 
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The significance and accuracy of such achievement ages, « 
pendent as they are on assumptions with reference to the n 
mality of distribution or upon extrapolation are much open t 
question. Seeing that there is so much difficulty in determining 
the standard scores, for a random group of (let us say) twely: 
year-olds, which actually exists and can be subjected to testing 
it would seem that any device which demands assumptions with 
reference to the scores of seventeen and eighteen year groups 
could hardly be considered a permanently satisfactory solution 
Moreover, there is again the difficulty in interpretation. In con 
sidering the achievement in an arithmetic test, how few of us are 
helped at all by saying that two performances are separated by 
an amount characteristic of the difference between sixteen yea: 
and twenty-three year old standing. 

Buckingham* has made the suggestion that in the attempt to 
procure ease of interpretation we should call, by agreement, the 
median achievement of Grades VIII, VII, VI, ete., 8, 7 and 6 
respectively. While this procedure is attractive in its simplicity, 
it suffers from the great drawback that it is impossible to refer 
the high scores of Grade VIII and Grade VII to any standard; 
they exceed 8 and we can only have by doubtful extrapolations 
ag, 10, I1, or 12, for hypothetical groups. The suggestion ot 
this present paper is to combine some of the merits found in the 
devices of McCall, Buckingham and Pintner, particularly the last, 
with certain other factors to accomplish the end of securing an 
obvious interpretation of any transmuted score, expressed in 
terms which make it readily applicable to the school and ad- 
ministrative situation. This suggestion is to transmute the crude 
scores of the test, into the mid-year distributions of the various 
grades, 

This procedure will be made evident by reference to Table | 
which was obtained from limited data on the four tests com- 
prising the Chapman Class Room Products Test.* In this exam- 
ination battery the four tests are: (1) arithmetic fundamental 


* Buckingham, B. R. ‘‘Suggestions for procedure following a testing pro- 
gram,’’ Journal of Educational Research, 2: 787-801, December, 1920. 


* Published by the J. B. Lippincott Company. 
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AF); (2) arithmetic problems (A P); (3) reading selections 
RS); (4) reading continuous (RC). For each of these tests 
nd for the total for Grade V, VI, VII, VIII the achievement 

at mid-year for the nine equally increasing (with generous 

assumptions!) lev els, 0.4 sigma apart, are shown. ‘These levels 
are given the descriptive designation shown in the first column, 
and the quantitative designation ranging from 1 to 9g, shown in 

e second column. Whether mid-year or end-year standards 
are chosen is a matter of agreement. For tests of skill which are 
the result of long training, the former is advantageous; for tests 
of informational material which is acquired in a single grade the 
end-year standard is referable. Assuming mid-year standards 

s given, suppose a pupil in Grade VI scores on the total test 47 
points. By referring to Table I, it is possible to determine the 
levels of achievement for Grade VI, VII or VIII. in the case 
considered, it will be seen that the particular pupil’s achievement 
is sixth-grade high or VI-7. This will be the usual status wanted. 

\Vhere, however, for purposes of regrading the desire is to dis- 

cover the place of the pupil in Grade VII or Grade VIII, it can 

he readily seen from the table that his score corresponds to 
seventh-grade median or VII-5, and to eighth-grade medium low 
or VIII-4. This illustration brings out an important merit of 
the proposed system of reporting. Those who are working in the 
schools with these measuring instruments are trying to break 
down certain ideas concerning the present system of grading, 
particularly the notion that a grade represents a narrow level of 
achievement of a homogeneous group. The most powereful 
instrument to employ in attacking this problem is one which 
shows on its surface the extent to which overlapping of the 
grades is present. This the suggested system is well calculated 
to accomplish; for when the transition is made from the crude 
scores to the equivalent scores, a momentary examination of the 
table shows that the same crude score may be characteristic of 
different levels of achievement in different grades. The proposed 
scheme focuses attention upon grades and the wide range of 
achievement in a grade, rather than on a distribution in terms of 
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ngle population. Of course, the wide variations of achieve 
nt on the continuous scale show the same thing, but do they 
is obviously? We have already made the point that the 
nking of the practical schoolman is in terms of grades, and that 
ntually children, as the result of the tests, have to be placed in 
les. There is, however, a further reason why standardization 
rade groups rather than by age groups should be given pret 
ce. This is found in the fact that the subjects in which we 
are taught by grade rather than by age. By this is meant 
ta certain part of history or civics ts taught to Grade VII and 
Grade VIII and not to 13- or 14-year-old groups. It seems dis 


, 
p a population such 


; McCall’s of which a considerable portion have never been 


intageous to use as the standardizing grou 
sed to the instruction in the elements out of which the test is 
nstructed. While this criticism applies much less to examina- 


ns in reading, and to wide examinations in arithmetic, vet in 


w 
S 
7 
4 
~~ 
J 
=. 


pecific elements in arithmetic taught 1 
inly very pertinent. 


We shall make no attempt to pass above the 95 percent point 


hich is called 9, because the data, unless originally very great 
mount, are becoming so attenuated at this point that reliability 
out of the question.’ Where the score passes bevond that of 


e 5th or g5th pupil at the extremes, it may well be left ind 
terminate, calling it 1— or 9+. To refuse to pass beyond these 

ints and to leave the rating indeterminate if less satisfying 
is at least an intellectually honest procedure 


hy 


For each grade there are thus nine levels each separated 
equal amounts. These for any particular grade, such as VI, 


are written VI-1, VI-5, VI-9, etc. Together with the indete: 


ate levels, VI-1 — and VI-9 +, there are thus eleven levels 
r each grade. If the data are sufficiently homogeneous and 
extensive to justify the process, we may insert intermediate 


steps with suitable descriptive terms and with quantitative desig- 


nation, e. g., 1.5, 2.5, 3.5, etc., up to 8.5. This would furnish 
1 


nineteen levels of achievement. 


*Yule, G. Udney. An introduction to the theory of statistics Fourth 
edition.) London: Charles Griff 


in and Company, | +] 
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When very fine correlation work has to be done w 
muted scores, it will of course be necessary to w 
aller limits than those afforded by the eleven or even th 
teen levels. This however will be a simple matter of inter; 
tion and extrapolation. We can readily decide not only 
ichievement « tf \ | 5 or \ 1-6, but also the achiev ement of \ 
\1-5.3 or VI-5.4. 


ven dealing with an extreme c 


ase falling beyond the e 
alent of 9 for a particular grade, it is surely better to pas 
higher group and place the case in that, than to rely or 
inaccurate points at the end of a distribution, as McCall is « 
pelled to do. Ifa pupil in Grade V1 falls in VI-9 +, it is oby 
that he is out of place, and that by referring to the distributi 
the higher grades, we can see where he fits. If, however, 
are giving tests to measure improvement, the scores of the t 
pupils at the two extremes would have to be given spx 
treatment 


When it is desired to work in age groups, the same proc« 


1 


as that abe ve adv cate d would be recommended. Here the | rel 


would be in Arabic instead of Roman numerals, e. g., 12-5 we 
indicate the me 


, 
| 


lian achievement of unselected pupils in 
neighborhood of 12 years old. Roman figures would alw 
indicate gra $, and Arabic fivures would indicate ages. Me 
while, seeing that almost all thinking takes place in grades, p 
ticularly when the problem is that of regrading, it is well 
establish the grade norms first rather than the age norms 


however, we wish to make comparisons from country to count: 


there is much to be said for age norms. Certain English writet 


for example Ballard, are making the appeal for age norms 1 
the simple reason that they do not understand the Ameri 
grading systems. 

In the matter of intelligence tests where primarily the thinki 


is done in age groups, the above convention would also appl 


The Arabic figures would represent the age and the figure fol 
s | s S 


lowing would indicate the level of achievement. In certain cas 


es 


where the measures of intelligence were very reliable, it mig] 
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we may determine the nine levels, or for finer grading the nis ¢ 
teen levels, in the same way as with a single grade group 
would be necessary to have some designation for such a series 
steps. Perhaps U. S. might be used, the letters standing 
“Universal Scale.” 
Such a combination of 100 unselected pupils from each of t! 
four top grades at mid-year has been made for the above m 
tioned test, with results as shown in Table II]. This combinati 
of 400 is treated as a single group, and the nineteen levels 
achievement in the totals of the four tests are exhibited. In t! 
way we get a scale which is continuous in the same way 
McCall's but which is less subject to the censure that extre: 
scores cannot be scaled. Furthermore, it is derived from a po) 
lation which can readily be obtained for testing purposes. Onl 
in a few of the wider tests, reading par excellence, could this broad 
population be used. Otherwise the procedure would be sub): 
to the same criticism as is McCall's, in that we should be stand 
ardizing our scale on a population a large section of which had 
been given very little or even no chance to score in the test. Tl 
fact that in the narrower tests we are compelled to use short 
scales, which, so to speak, break at various points, is probably) 
inherent in our problem. The physical analogy of the yard stick 
while suggestive, is not really applicable. There is continuity, 
for example, in height within any group, say twelve-year-olds ; 
but the same ts not true for knowledge of civics, or of interest 
in arithmetic. Here we strike the problem of the undistributed 
zero. 
To avoid misunderstanding, it is perhaps well in closing to 
point out explicitly two demerits of the universal scale procedurt 
The first is found in the experimental fact that grade groups 
are less constant than age groups in achievement. This is caused 
by differing procedures with reference to promotion from system 
to system. The second disadvantage is that in dealing with grack 
groups, standardization must take place at some definite point in 
the history of the grade, presumably either at mid-year, or at 


end-year. In contrast to this limitation, standardization by age 
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1 | ] > tir Y ] ; 
in in the general case be done at any time Neither of 
x backs 1s sufhcient to prevent t procedure from being 
oats . . ‘ : 
The first point has already been met; whatever norms 
' “1 } ‘ Be. : ees a ‘ +] ' ] 
ned will alwavs be subject t greater maccuracy t n will 
ced bv varving standards of promot Pi bly care 
TABLE II.—A UNIVERSAL SCALI 
QUA rivi 
DESCRIPTIVE PER- DESIGNATION Cr 
DESIGNATION CENTILI EQuIVALENT Scorn 
mpprox PcCcoRt 
Indeterminate 
ighest US-9 bs 
Highest 95 Us-9 67 
2 UsS-8.5 03 
Very high SS US-S 60 
S4 US-7 4 57 
lig 79 US-7 y 
io US-6.5 {) 
Medium high OH S65 11} 
a TS.5 5 13 
MEDIAN 50 US-5 10) 
12 LS-4.5 s7 
Medium low 34 US-4 34 
Zi S-3.5 1 
Low 2] 17S.2 rg 
16 Us-2.5 25 
Very low 12 USs-2 23 
S IS-1.5 >} 
Lowest 5 US-1 18 
Indeterminate 
lowest US-l li 
: Totals in the Chapman Classroom Products Tests at the various levels Popula 
100 unselected pupils from each of Grades V to VIII 4 pupil scoring 53 is 


rded as US-7. 
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will have to be taken to secure standardization material 

school systems in which the age -grade tables are reasonably 
mal. The second point raises a real difficulty but not as gr 
that which will have to be met in combining age groups, a 
cedure to which I believe, McCall will have to resort 1f his 
is to be at all reliable at the extremes. To secure unsel 
twelve-year-olds is within the bounds of possibility, but the hi 
unselected age groups can probably not be attained and thx 
unselected age groups will bring in the problem of the wu 
tributed zero, 


SUMMARY 


This paper presents a scheme of reporting test scores where! 
after the transition has been made from the crude score to 
equivalent score, the latter bears, upon its face, an obvious ar 
useful interpretation. 

Nine equally separated levels of achievement for each gr 
are set up. These levels for a particular grade being referred t 
as VI-4, VII-8, ete. In addition to this quantitative rating, the 
nine levels are given a descriptive designation. 

For age groups, the same method of report applies, Ara 
numerals replacing the Roman numerals. 

Intelligence levels at all ages admit of treatment by the sa: 
method. 

Where a continuous scale is demanded, the mid-year Grad: 
VII scale is suggested. If this is not wide enough, an unselect 
population consisting of the four top grades (at mid-year ) 
equal number is recommended. This is treated as a single grow 
and the same nine levels determined. If the data are extensiv: 
these nine may be extended to seventeen or much further. T! 
designation for a level of such a group is US-5, US-8, ete. 


In every case the figure or letter before the hyphen signifies 


the group to which reference is made, the figure after the hypher 
indicates the level attained. 

















JOURNAL EDUCATIONAL RESEARCH Vol. 5, N 


— 
~ 
te 


these questions. The investigation was carried on in the cit 
of Minneapolis and St. Paul, where the population is sufficient! 
polyglot to justify considering these cities as typical of the inla: 
centers of population. In all, 2653 cases of school children w: 
studied, and data were collected with reference to the birthpla 
not only of both parents of each child, but also of the four gra: 
parents. In 2607 cases the birthplace of the father was dete: 
mined, and in 2491 of these, of the four grandparents as wel! 
The nationality of the child was based upon the place of orig 
of his grandparents, according to the following method. TT! 
birthplaces of the parents were disregarded, and the child w: 
listed as belonging to that nationality shown by the predominatin, 
number of agreements of his grandparents. That is, if all fou 
grandparents were born in some one foreign country, the child 
was listed as being of that nationality; or if three were of or 
nation and one of another, or two of one nation and the other 
two of different nations, the majority of grandparents deter 
mined the nationality of the child. But where there was no pr 
dominance, as where two were born in one country and the othe: 
two in another, the child was regarded as of “mixed” nationality 
and so was not included in tables of comparison. To make th 
matter clearer, if all four grandparents were Norwegian, or if 
three were Norwegian and one Swedish, or if two were Nor 
wegian, one Swedish, and one American, the child was listed as 
Norwegian. But if two were Norwegian and two were Swedish 
he was listed as of mixed origin. Thus, a comparison can bh 
made between the results secured by listing children according t 
the birthplaces of the fathers, and the results obtained from using 
the places of origin of their grandparents. Table I shows the 
comparative results. 

No close analysis of this table is necessary to make clear 
two points: first, that there is a fairly close agreement between 
the foreign-born groups, and second, that there is no agreement 
at all between the American-born groups. Accordingly, it may 
be inferred that the birthplace of the father is a fairly accurat: 
index of the origin of the child if the father is foreign-born, but 


ACCURATE INDEX OF NATIONALITY $23 


I—NATIONALITY OF CHILDREN ACCORDING TO BIRTHPLACI 


FATHER AND ACCORDING TO BIRTHPLACE OF TW OR 


MORE GRANDPARENTS 


BIRTHPLAC! PATH cipher Reawtoces 
(JRANI ay . 
| nited States 977 
Great Brita 140 lt 
Get mi 104 177 
Norway 209 215 
we n $22 11) 
\ustro-Hungary 142 129 
R i i J W l " ") 
Russi lew 40 t 
ie na 22 Ss 
hur { 5) } 
Der rk 1 2 
It ily tt) Tw 
Mis llane yITS | ‘ny 
Mixed origin, no pr 
aominants 157 
Zt y. ; 


it is not at all an index if the father is born in the Unit 
Therefore, whenever there 1s any comparison of foreign 
nality with Americans, the father’s birthplace cannot be 
as a fair index of the real ancestr\ f the child; and such 
irisons must be based upon more accurate mtormation 
when comparisons are made between national groups wher 
ericans are excluded, the birthplace of the father may b 
lered as a rough index of the child’s ancestry \n objec 
is frequently made that it takes too much time and tr 
htain the data relative to grandparents; but it may be pointed 
that the meth« d « rdinarily employed, namely, having a « 


out at home by the child’s parents, will involve but little 


i 








time or trouble, if the parents are asked to include as well 
birthplaces of grandparents 


\ study also was n ade of the relative influencs 


1 the mother in detern ining the language spoken in the hom 
he cases were classified into five groups as foll 
American born fatl toreig 
Both speak English at | . 
Both speak foreign lat ( 
Father speaks Englisl t { 
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Foreign born father, American born mother: 
TOU CCE TAR ave cexndvsanciecebesicdive eames 139 
Both speak foreign language. ............seeseecees: 61 
Father speaks native language, mother speaks English 9 


to 


toth foreign born, one of one country, one of another: 


3- 
tee. SOE DOR 510.646 6:59 05.4006 00006090%445-044 52 
Soth speak father’s language.........cecccesccseces 21 
Both speak mother’s language. ..........sceesesseees 13 
Father English, mother native..................005- 
Father native, mother English....................6. 5 
Each original language, unchanged.................. 13 


4. Both foreign born, in the same country: 
Mother speaks English, father native.................... 


Both born in the United States: 
Father speaks English, mother a foreign language.... 2 


in 


Mother speaks English, father a foreign language.... 1 
Both speak a foreign language.............0eeee000: 21 
EE ROS go. 0 06-0000660034040065 406540000700 E0805 459 


A summary of the above cases shows that in 166 the father 
has seemed to dominate since his native language has been adopted 
as the home language; and in 165 the mother has seemed to have 
the greater influence. In 36 cases the original differences of 
birth have persisted, there being “no compromise.” In 55 cases 
the father and mother speak different languages in the home 
Of the 115 foreign-born cases where both parents are foreign- 
born, only five fathers speak English at home when the mothers 
retain the native tongue, but eleven mothers speak English while 
the fathers use their native language. 

Naturally, the conclusions to be reached are largely colored 
by two great factors, first, the natural tendency to pick up and 
to use English in an English-speaking community, and second, 
the tendency to continue the use of the foreign language where 
grandparents are resident in the home. In the latter case, the 
influence of the father might frequently be neutralized by the 
presence of his wife’s foreign-born parents, and vice versa 
However, these factors do not affect the main point, t.¢., that the 
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‘dence shows rather conclusively that the father is by no means 


he assumed to be the predominating influence in determining 


, 
LLaae 


nosphere of the home. Rather must it be concluded that 





mother is at least quite as influential, with the general pre- 


( 


derance in her favor. All of this seems to demonstrate that 
is no good ground for assuming that the birthplace of the 


re 
er is any clear indication of the language spoken at home. 


From these two studies, there seems to be no doubt that for 


he groups studied, national comparisons drawn on the basis of 


‘he father’s place of birth would be very largely erroneous and 
isleading. Inferentially, a similar doubt would be placed upon 
'! conclusions drawn from data collected without further knowl- 
ive than the origin of the father. Since but little more time or 
uble will be involved in getting all of the needed data, is it 

» much to ask that in future, the studies of school children 
‘nvolving nationality be based upon the birthplaces of their 


vrandparents ? 
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WHAT IS A PUBLIC SCHOOL 


In England nine institutions have been known for many y: 
as the Great English Public Schools. They charge exorbit 
fees and cater to the élite. Satirically—and with the half trut 
that makes satire effective—it has been said that they are call 
great because they limit their ministrations to a few high! 
selected students, English because Greek and Latin constitute the 
core of instruction, public because none but the rich can attend, 
and schools because the chief interest is football and cricket. 
few institutions in this country resemble these aristocratic corp: 
rations. But we do not call them public schools; and not many oi 
us think of them as great. English, however, they may be. 

In this country a public school is free and tax-supported. But 
it should be much more. It should serve the public and should | 
understood and admired by the public. 

Not long ago the writer visited a school system in a peculiar 
community. <A fine progressive spirit was evident among t! 
teachers and supervisors. Modern buildings were either avai 
able or under construction. Good teaching was being provided 
The schools, however, were isolated. Their lines of communica 
tion with the public were insufficiently maintained. No parent 
teacher organization was in evidence. ‘Though the teachers wer 
carefully selected and manifestly of good ability, their contacts 
with the community appeared to be few. They seemed to lx 
living unto themselves. Their social talents, which were of 
high order, were exhibited for the most part to each other. 

Such a school falls short of being “public” in the best sense 
It is likely either now or later to suffer from a lack of the materia! 
support without which good teaching, good buildings, and good 
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ent cannot be purchased \loreover. it will have littl 

larger influence upon the life of the community which ts 

its privilege and its duty. Cluldren will be sent to school 1 
ise they must be sent; but, they will be withdrawn as s 
e compulsory age 1s passed, and « ce the 


9 aroun as 
rs will be unable to count on parental support. Wath the 


| 1 
1 and home working independently f each P t 
purposes, even the narrower objectives of th school will 
, "1 ] iy f ae. “ayy 
tively unattainable Phe progress of pupils will x 


elimination will be high. Bovs and girls t old for their | 


} 1 aT +] ? } ech + +} 
es will be numerous, and the memb« ip of t 


On the other hand, the public will be deprived of the good 
luences of a real public school—of a school which reach 


the community, shares its best endeavors, and gives 


entum to its best impulses. In the district wher 
nducted behind closed doors the business 1 n compl 
loudly that children can no longer spell 
mmatically. The “best citize ns” and their 
hers as socially impr ssible, while by others the 
snobs. And the pity of it is that both characterizations tet 
hecome true as the school continues to hold itself aloof fror 
pe ple. | 


The public, and the school must, therefore, be br tt 


ther. The public is really tremendously inter sted—or will be 
its attention is called to its interests. It provides both th 
nev and the children: and these constitute at once the essen 
ls of the school and the people’s dearest possessions. It would 


eem, therefore, that only through the existence of r lly un 


itural conditions can the school and the people be estranged or 


even become indifferent to each other. Wherever such conditions 

ive insensibly developed, it should be the first care « 
people to banish them. 

That school is truly a public school which is not only free at d 


tax-supported but which is also operated as a high public trust 


Such a school will render continuous account of itself to the pub- 
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lic; 1t will take the public fully into its confidence; it will 
nd maintai n the basis of undisputable worth, its rig 
d its ab to inspire When a crisis comes whel 
r obstructionists arise, or when business depression reduc: 
uations—su sé | will be protected \ristocrats will 
the children t t instead of to exclusive private s 
Fathers and mothers ristocratic or otherwise will wish 
children to enter it t n early ot d re in in it as Ie 
p* ssible They will speak well of the school and sec nd 
efforts of teachers. Undoubtedly one of the best ways to re 
rdation and elit ition 1s to begin with thi rents. M 
I syste ich has been surveyed and found wanting 
nothing so much as to become a real public school 
B. R. |] 
THE PRINCIPLE OF RANDOM SAMPLING 
IN SUPERVISION 
One big difficulty in supervision is that the supervisor 1 
ubiquitous. He cannot be here and there, too; and if he ts 
today he must be there tomorrow. If he has lately given at 


tion to arithmetic in the sixth grade, the next time he « 


look « ver a set 


spelling papers. It 1s hard to give consecutive attention to 
particular type of work long enough to effect improvement 
Standardized tests, however, have multiplied the hands ot 
supervisor. He may not appear in the classroom as often as 
used to—nor as often as he would like to; but he may be kee 


track of things far better than formerly. Contemptuous refe1 
ence to the “office superintendent” means nothing unless we kn 
what he is doing in his office. He may be making effective us« 
the devices of statistics, either in conjunction w 
wdardized tests or without them. We called attention in 
recent issue to an application which he might make of the media 


Another statistical principle that will help the supervisor 


wat of random sampling. Let him rate the forty pupils of 


class in any subject, and then let him select at random the ratings 
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enter in a record book the facts which the teachers have endors 
on each package. This pupil will also draw from each packag 
certain number of papers (say ten). These papers are 

random samplings from an inspection of which the principal wi! 
obtain a fairly accurate estimate of the work of each class for 
given day. It is suggested that he read each of these ten pap 
for each class and that he rate each paper as satisfactory or w 


satisfactory. It will in general be found unnecessary to reco; 


more than these two classifications—namely, satisfactory or 
satisfactory. If seven of the papers are satisfactory, the cla 
rating is seventy. If eight of them are satisfactory, it is eight 
After the random samplings for each class have been examin: 
and rated in the manner indicated, the principal will indorse 
rating on each package and enter it after the name of the cl: 
in the record book. The packages will then be returned to t! 
teachers. 

By this means, it has been found possible for a principal 
give close attention to the work of as many as twenty-five class 
without an undue expenditure of time. The amount of impro\ 
ment in English writing which has resulted from the use of this 
device has been exceedingly gratifying. 

This, however, is only an illustration. What we wish 
convey to the reader is first, that a number of statistical principles 
may be used by the teacher and especially by the supervisor wit 
very gratifying results, and second, that the method of rando1 
sampling is a device which is particularly effective and distinctly 
economical of time. 


B. R. B 
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TrRYON, RoLLA MILTON. The teaching of history in the junior and senior hi 
schools. New York: Ginn & Company, 1921. 294 pp. 

This book on the teaching of history in the junior and senior high schools 
fulfills a long felt want for a book bringing together many concrete suggestions 
and devices for the teacher of history. It will be particularly helpful for the 
beginning teacher who faces the problem of organizing several courses in ¢! 
various fields of history. 

The chapters giving suggestions on methodology are very helpful. Th 
describe at some length the history recitation; detail ways and means of teac! 
ing pupils how to study history; analyze and evaluate special methods of pro 
cedure such as the lecture, topical, textbook, source, and problem methods of 
presenting subject matter. The book also comments upon written work in 
history, such as, the permanent notebook, the collateral reading done in the 
library, and the term paper. 

Some of the other chapters in the book are not as concrete as those deal 
ing specifically with methods of teaching. For example, the section on Progress 
within the Subject, does not clearly set forth differentiating principles for the 
allotment of subject matter to each grade. The chapter on Measuring the Re 
sults of History Teaching would have been of more service if it had suggested 
which of the standardized history tests to use, and how to interpret results so 
obtained. 

A very important section in the book, particularly for the new teacher, is 
the one on Planning the Course and the Lesson. In the opinion of the re- 
viewer this chapter could well have been expanded. Concrete proposals are 
made concerning the main and subordinate topics to be covered in the course 
and illustrations of daily lesson plans are given. They indicate the importance 
of a daily outline including important events, persons, and dates; further ref 
erences; maps; and pivotol questions and exercises. Such suggestions should 
stimulate teachers to work out an efficient method of organization and also 
make the daily teaching of history more pleasant. 

It is to be regretted that certain of the much discussed psychological as 
pects of history teaching are not discussed in the book. We need a discussion 
concerning the place of association in history teaching, and answers to such 
learning problems as (1) how much repetition is necessary to ‘‘fix’’ important 
historical facts? (2) How can we stimulate and train the imagination and 
judgment in the teaching of history? The little research done thus far on the 
psychology of history has not been reported in sources available to the average 
teacher. Books presenting material on the teaching of history should at least 
summarize this data. 

The reviewer agrees with the statement in the preface of the book that 
while there are many ways of teaching history, it is fundamental to educa 
tional method that the teacher know that there are a number of ways of doing 
a multitude of things connected with the everyday procedure of that subject. 
This book tells the teacher of history about many of these ways and points out 
a procedure in managing them. 


Ear. W. Rvae 


Columbia University 
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tions often asked by teachers. These features are discussed in simple langus, 
in terms of the underlying principles that have been recently formulated 
scientific researches. This method of presentation is commendable becaus: 
tends to keep the amateur teacher from the rut of ‘‘ blind imitation.’’ 
The chief negative criticism of the three foregoing desirable features of 
the manual is the meagerness of illustration. For example, it is questiona) 
whether there are enough illustrations of the ‘‘ best methods’’ to make e: 
one of them clear to a beginner in the field. Not only from the standpoint of 
clearness, but also from that of the felt needs of the amateur teacher it wou!) 
seem that more illustrations might well have been given of the ‘‘ best methods,’’ 
of the materials, and of the devices. The popularity of the publications 
devoted to devices supports the latter reason for more illustrations, 
There is a tendency for the authors to eater to the technical demands of 
the investigator in the field of spelling. For example, note the detailed 
presentation of ‘‘A Suggested Minimal Spelling List’’ on pp. 79-85 and tly 
extended bibliography of 78 titles at the end of the manual. Such lapses fro: 
the primary purposes of the manual would not seem to enhance its value to 
the inexperienced teacher. 
May we offer two other negative criticisms? First, we fail to see why the 
chapters were not numbered consecutively. Second, minor errors or editing hav 
been overlooked. For example, in the Table of Contents, p. viii, the Biblio 
raphy is not given as Part III, where as it is so given on p. 137; and on p. 2 
the word ‘‘Interest’’ in black face should be an ‘‘inset’’ in the last para- 
graph instead of in the one in which it appears. 
However, regardless of these criticisms the inexperienced teacher will be 
well repaid in suggestions gained by reading the manual. 





















~ 


A. G, Carrs 
University of Missours 


THORNDIKE, Epwarp Ler, The new method in arithmetic. Chicago: Rand 

MeNally and Company. 1921. 260 pp. 

A long time ago we all learned from our readers that for want of a nail 
a shoe was lost; for want of a shoe a horse was lost; ete. In this book 
Professor Thorndike is not too big to be above the nails of arithmetic. Nor 
does this by any means imply that ample recognition is not given to thinking 
and applied superstructure. Some given to dialetics may wish to argue whether 
or not the school should be more cultural or more disciplinary, more academic or 
more vocational, et cetera, but the implications of the foregoing have validity 
only if and when children can add, subtract, multiply, divide, measure and 
weigh, handle commonly used fractions, compute interest and taxes, discrim 
inate in investments, and intelligently appreciate numerical relations in the 
problems of farm, industry, business, and travel. 

‘*The New Methods’’ exemplified are based upon ‘‘ principles discovered 
by the psychology of learning, by experimental education, and by the observa 
tion of suecessful school practice.’’ The chief concern of the author is not a 
defense of past procedure but a vigorous advocacy of the best principles derived 
from careful experimentation. We all know how comfortable the old shoe is, 
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re comes a time when we must step out with the new pair The Thor 
etics (Rand McNally) are used throughout for illustrative purposes 
nsfer’’ has a mighty effect with any modern set of good texts hi 
g structed from the point of view of the rking teacher who may 
, rect knowledge of psychology rn ‘ etaile 
n and application and further er f-chapter « s. College and 
usses should find much mate ! New Ms lo 9? 
r headings give int itor f the } t ‘ t +} } | 
f ing are typical: Reality Interes Che Ey stiot 
t I mation and Drill Solving Problems | } cas G | , 
ps Some Common Mistakes = e Instr tive Disputes lests and 
it s. Under what simpler or more sensible doctrine « 1 a method 
thmetie be launched than with the pre ‘ ‘eT he me @ 
rithmetie for arithmetic’s sake, reg S f the needs of , The 
r methods e1 e the pr esses W h life eq ‘ t t ema 
fe will « 
R ‘tv ?? ig sensed it ‘‘The newer methods set a higher star - 
tion and construct 2 a 7 ble s, reg T not « that the give 
n opportunity to think and to apply a metical knowledge, but 
t thev teach him to think and to apy irithmet to situat a suck 
I offer, in uselu and reasona ef WAVS, AT 1 so t est aritt t 
! sag 1] game for the mind but also as as stant 1 he life’a 
In fact the problems which ‘*« ld oceur in real life on 
asvlum’’ are conspicuously absent fr Professor Thort s treat 
Note the verv significant contrast however when 2 times ° ' a 
nd 4— 2, 6 ~ 2 are taught as tables in connection with pints quarts 
e cost of postage stamps And goodbye for ‘‘ Denominate Numbers’’ as 


in a separate suite. Old Messrs. Foot, Yard, Pint, Quart and Gallo 


t, mingle and strike up lasting acquaintance ‘‘ bonds’ igl 


when prohibition becomes firmly fixed, Professor Thorndike will be 


first to snub, arithmetically speaking, the more out-of-date members f the 
ve family. 
[wo potent interests are recognize 1: nterest n mental { es 
nterest in achievement While the newer met! s increase the strengt! 
these two appeals, arithmetical thinking should be preserved from wast 
1ilure due to difficulties of vocabulary and constructior Interest throug 
- vement is most laudable, with definite tasks definitely set wit - 
lefinitely measured and noted 
The older methods made much use of explanations based upon deductive 
asoning and beyond the child’s grasp. 1 he newer methods at t secur 
lerstanding of rules and principles but by an tnducti reasoning based 
n the simple premise ‘‘ because by so doing I get the right swer s 
swer however being submitted to verification. ‘‘ The newer 1 ethods lay mor 
ess on the pupil’s surety that the le or process is right and less stress o1 
s ability to state in words a proof that would satisfy a mathematiciar The 
hild verifies the results obtained in 6 % (after multiplying ¢ ‘ I 
ng a 6 inch strip into % inch lengths. The rule that |} formulates is 





























News Htems and Communications | 


This department will contain news items regarding research | 
workers and their activities. It will also serve as a clearing house | 


for more formal communications on similar topics, prefs rably of not j 
more than five hundred words. These communications will be printed | 
over the signatures of the authors. Address all correspondence con 
cerning this department to Doctor E. J. Ashbaugh, Ohio State Uni 
versity, Columbus, Ohio. 














The Third Conference of the DPureau of Educational Reference at 


search of the University of Michigan was held Tuesday, March 28th 


program consisted of eleven ten-minute reports from workers in the field 
papers wert largely grouped about the two subjects of intelligence testing 
silent reading, though other phases of school work are not entirely neglect 


Superintendent Bonner Frizzell, Palestine (Texas) reports that for 
past three years a local newspaper has given a full page to high-school ne 
This page is edited by a staff of students under the supervision of the Eng 
Department. He also reports that a special study room teacher is empl 
who has charge of attendance records, monthly reports, and supervision of 


study hall, but does no teaching. Such an arrangement is said to be } 


We have received from the Superintendent’s office of the Hackens 
(New Jersev) Publie Schools a Teacher’s Manual, a Janitor’s Manual, ar 
Bulletin on Seat Work Exercises for grades one to three. The Teach 
Manual contains the general information with which each teacher in 
school system should be familiar. It is in mimeographed form but fully 
dexed. This fact permits easy revision and adds to the accessibility of the 1 
terial. Such a manual placed in the hands of a new teacher should ass 
greatly in helping her to adjust herself to the workings of the system. 
Bulletin on Seat Work which was prepared by the teachers should make 
uniformity of such work without in the least interfering with initiative in 
right direction. 

The Normal College Index from the State Normal College, Dillon, M 
tana for March 10th is called the ‘‘School Discipline Number.’’ The mz 
articles in the number deal with the problems of discipline. ‘‘ How Disciplinar 
Problems are Solved by Your Co-Educators,’’ ‘‘The Relation of Discipline 
the School to Community Life,’’ and ‘‘ Discipline in Theory and Practice’’ ar 
among the subjects It is evident that the Normal School is endeavor 


through its paper to carry out to the teachers in the State some of the lessons 


which the instructors are giving the resident students. 
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cities with the exception of towns of less than 500 population, the sals 
grade teachers was greater in 1921-22 than in previous years. 

The median salaries of superintendents showed inereases for men ¢ 

cities of 5,000 to 10,000 population. High-school principals increased 
salaries with but two exceptions—namely, in places of less than 1,000 7 
tion and in the case of men in places of 2,000 to 5,000 population. W 
high-school teachers showed increases in cities of every size. Men hig! 
s, however, increased their salaries only in cities of 2,000 to 5, 
in cities of over 10,000. 

The Lewiston (Idaho) State Normal School Bulletin for January, 19 
devoted to the Testing and Teaching of Silent Reading, by C. L. Hi: ; 
Head of the Department of Tests and Measurements and his Assistant, I. > 
Madsen 

The Bulletin reports results from the Monroe Silent Reading Test 
schools of Idaho during the school year of 1920-21. Over 7,000 children 
involved. Distributions and central tendencies are presented in clear d 
and graphs are given to show the relative standing of class A cities, sn 
cities, and rural schools. Three of the conclusions are as follows: On 
basis of the central tendencies of all children in each type of schools, the rar 
on both speed and comprehension are the same. Schools in Class A cities se 
best, small city schools next, and rural schools poorest. Intelligence is s| y 
to be a potent factor in the achievement in silent reading. Pupils in any giver 
grade who have spent the fewest years in school have the best scores in | 
speed and comprehension. 

One section of the report is given to suggestions for improvement in sil: 
reading attainments. These suggestions cover recommendations as to how t 
increase speed or to inerease comprehension. The following suggestions 
given for meeting the individual needs of pupils: (1) grouping of pupils, 
personal attention to individuals, (3) gradation of materials used in pract 

t) variation in the amount of reading practice, (5) adaptation to and 
velopment of motives, incentives, and interests of individuals, and (6) spe 


phases of instruction. 


Some of our readers may not be acquainted with the Research University 
of Washington, D. C., which was founded and incorporated under the laws of 
the District of Columbia for the purpose of providing federal employees a: 
other men and women with an opportunity of gaining such college training as 
is necessary for efficiency and happiness. Most of the work is taught after 
five o’clock in the evening when day workers may take advantage of it, 
although day classes are also provided in a number of subjects. About 2 
correspondence courses are offered for those out of the District. The instit 
tion has grown from one instructor, a handful of students, and one room in thy 
fall of 1919 to a faculty of 75, a student body numbering nearly 1,000, ar 
two large buildings. The president of the institution is Dr. Louis W. Rapeer 

The University is operated on a cooperative basis. The tuition is kept ss 
low as is consistent with the policy of avoiding begging either from ind 
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the pupil certain information and certain directions, and to place befor 
definite tasks to be done. In the subject of arithmetic these tasks wou! | 
graded examples. On each page he finds ‘The Way To Do It.’ This consists 
of a typical example worked out and explained. The pupil then tries | 
hand at working the examples given. On the sheet are directions to look fo; 
others in textbooks. The sheets we have called Job Sheets, because we are 
bunching them into pads of eight and ten; and when the pupil finishes a set 
he gives this to his teacher who places it with his other work as a finished j») 
When he has completed his entire set of jobs, he will be given others. |; 
this way he is working ahead of his class, if he is a bright pupil, and trying 
to catch up, if he is backward. We are at present working out the job sheets 
in English and arithmetic. We feel confident that the job sheets will prove 
a time saver and will also demonstrate to teachers that pupils can do a great 
deal more work than we have imagined them capable of doing. For instane 
a principal and I both decided that a certain number of jobs which we had 
ready would require two weeks for the pupils to finish. Without any dis 
cussion as to time and with the simple suggestion that this work might be don 
whenever they had any extra time after preparing their regular lessons, the 
pupils who accepted the sheets finished the entire set in two days! Since then 
my office force has tried in vain to keep up with tlie demand that the pupils 
are making for the job sheets.’’ 


A National Council for the Social Studies completed 
National Council its organization in Chicago on February 25th. Its purpos 
for Social is to lay the foundations for training democratic citizens 
Studies and its sponsors believe that such training can result only 
from a carefully developed and adequately supported sys 
tem of teaching in the elementary and secondary schools. Its plan looks t 
promoting cooperation among those who are responsible for such training, ir 
eluding at least the university departments which contribute knowledge of facts 
and principles to civic education; and the leading groups of educationa! 
leaders, such as principals, superintendents, and professors of education, who 
develop the methods of handling these facts. 

An advisory board was set up composed of representatives of (1) the five 
associations of scholars most nearly related to the purpose of the Nationa! 
Council,—historians, economists, political scientists, sociologists, and geogra- 
phers; (2) the national organizations of educational investigators and admi: 
istrators—elementary and high school principals, teachers of education, normal! 
school principals, and superintendents; and (3) regionary associations of 
teachers of history and eivies, The function of this advisory board is to bring 
into the National Council the points of view of the organizations represented 
hy its members and to insure a development of the social studies which wil! 
he in harmony with the best educational thought as well as based on the best 
present practice. 

The following officers were elected for the year 1922-1923: L. C. Marshall, 
Professor of Eeonomies in the University of Chicago, President; Henry John- 
son, Professor of History in Teachers College, Vice-President; Edgar Dawson, 
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intendent, and Angelo Patri, Principal P. S. 45, New York City; and Dr 
W. W. Charters, Carnegie Institute of Technology. 

The sectional meetings which oecurred on Friday ineluded the following: 
Administrative and Supervisory Research, High Schoo! Principals, Elementa; 
Principals, Teacher-Training, American History, Art, Biological Science, N, 
Biological Science, English, Latin, Mathematics, Modern Languages, Hon: 
Economics, Industrial Arts, Musie, Vocational Agriculture, Physical Education 
Clinieal Psychology, Educational and Psychological Tests, and a demonstra 
tion of Educational Tests. 

It had been hoped by those in charge that the program would appeal to «|! 
classes and grades of educational workers in the State. The attendance of over 
2,500 persons representing practically every phase of educational work woul: 
seem to justify the belief that this purpose was realized. A number of cities 
dismissed school in order that all teachers might be present for the Friday and 
Saturday sessions. Others made special provisions for the release of the 
administrative and supervisory forces. 

The exhibits held during the Conference attracted a great deal of atten 
tion. Professor A. E, Waller of the Department of Botany and Professor 
D,. M. DeLong of the Department of Zoology and Entomology prepared an 
exhibit of biological material which indicated ways of improving teaching 
and increasing interest in the biological sciences. The Department of 
Physical Education of the University displayed what was, as far as can 
be learned, the first physical education exhibit to include all phases of such 
work from the elementary school through the university. The Department of 
Psychology had an extensive exhibit of educational and mental tests. An 
exhibit of some two thousand textbooks and educational pamphlets was pre- 
pared by the Bureau of Educational Research. The large numbers attending 
these exhibits and the great interest evinced by all visitors was satisfactory 
evidence that a distinct service was rendered in this manner. 


The Validity of Timed-Sentence and Column Tests in Spelling 

A few years ago a number of workers in educational research, notally 
Courtis, Fordyee, and Monroe, ealled attention to the fact that ‘‘the percent 
of correct spellings is higher when the words are dictated separately than when 
the words are dictated in timed sentences and the pupils forced to write at 
their normal rate.’"* The subsequent production of ‘‘ Timed-sentence Spelling 
Tests’’ has greatly affected the practice of surveyors, superintendents, anid 
teachers desiring to measure the spelling ability of groups of pupils. The 
prevalent opinion seems to be that ‘‘ by using the words embedded in sentences 
and dictated rapidly enough to foree the child to write at his normal rate, 
we measure the spelling ability which functions in one’s every-day writing.’” 
The Monroe tests and similar tests constructed by teachers and superintendents 
have been very extensively used. I have before me five mimeographed bulletins 
reporting the results of this year’s (1920-21) testing in as many Ohio cities. 
All employed timed-sentence tests for measurements in spelling. 

1 Monroe, Walter S., Measuring the Results of Teaching. Boston: Houghton 


Mifflin Company, 1918. p. 182. 
Ibid, p. 183. 
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Test B 


**Now turn the sheet over and use the other side. ‘I have some sentenrrs 
which I want you to write as I dictate them. I am going to dictate them 
rather rapidly, possibly more rapidly than some of you can write. If , 
have not finished writing one sentence when I begin to dictate another, I want 
you to leave it and begin on the new sentence. If there are any words | 
eannot spell, you may omit them. Take time to dot your i’s and cross your 
t’s. If you have any question about what you are to do, ask it now, becaus: 
you cannot ask questions after I begin to dictate.’ ’”* 





The sentences follow: 
60 Christmas came on Wednesday last year. 
32 Really you ought to refer the argument to your teacher. 
17 His condition is serious today. 
43 Education is for the common people. 
12 They will arrive by automobile tomorrow night. 
51 Already the theater is showing motion pictures. 
32 He will entertain a visitor next week. 
3 I am often in doubt about my lesson. 
31 The recent conference was a pleasant one. 
5 The general purpose is good. 


When the second hand reaches 28 stop the writing. 


Test C 
‘*Now turn the sheet over again. I want you to write another list 
words beside the list which vou have already written. I shall pronounce each 
word twice, as I did before. Remember to take time to dot your i’s and cross 
your t’s and to ask no questions.’’ 


The list follows: 


1. combination 6. circular 11. estimate 16. system 21. government 
2. neighbor 7. article 12. impossible 17. associate 22. witness 
3. difference 8. increase 13. treasure 18, political 23. national 
4. examination 9, neither 14. director 19. attention 24. business 
5. volume 10. marriage 15. local 20. service 25. convention 


The class record sheet provided blanks for the names of the pupils and 
the three scores in adjacent columns. It was therefore a simple matter to 
correlate the scores. The Ayres short-cut for the Pearson formula’ was em 
ployed for this purpose. The statistical work is considerably lightened by this 
procedure provided that one possesses such mechanical aids as a listing adding 
machine and caleulating tables. All work was checked to insure a high degree 
of accuracy. On the average, one error was found in each 2500 items. 


¢ soon t op. cit. p. 185. 
res, Leonard P., ‘‘A Shorter Method for bt taatate the Coefficient of Corre!s 
tien," Pekan of Educational Research, 1: 216, 221. 
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I. Q. indicates the brightness of a class, but tells nothing of how hig 
how low it stands in respect to mental development. A first-grade class 4) 
an eighth-grade class may both have an average I. Q. of 110 which places t 
on a par so far as brightness is concerned. The difference in intellige; 


however, would be about seven years of mental age. This difference is 1 
















significant one for purposes of supervision. 

In Saint Paul we have just concluded the examination of thirty-two VIII-A 
classes. In each case we have ecaleulated the median mental ave and 
median I. Q. If one arranges these classes according to mental age, the ord 
will be very different from that of the classes ranked according to I.Q. For 
example, the class occupying the second position from the top drops to the 
seventeenth place. Other classes rise or fall a number of positions. This is, 
of course, due to the varying chronological ages of the pupils who make up the 
several classes. To rate according to the I. Q. is to assume that the average 
ages of classes are the same, but this assumption is not true and the conclu 
sions drawn from it are not valid. The table given below shows the displac: 
ments in rank which take place when classes are rated according to median 
I. Q. instead of median mental age. It should be remembered that the maximum 
possible displacement in rank among 32 classes would be 31 positions. 

















Displacements Number of 
in rank Classes 

0 1 
5 Y 
1 1 
1.5 + 
2 5 
2.5 3 
3 1 
3.5 I 
4 1 
4.5 2 
5 2 
5.5 1 
6.5 2 
7 1 
8 2 
10 1 
1Y 1 
14.5 1 
Average 4.2 





on 


The above table shows that only one class out of 32 retained the same 
rank. Several classes suffer severe changes, while the average of the displace- 
ments is 4.2 positions. This shows clearly that these two methods of evalua- 
tion of mental ability will yield widely different results and that as a conse 
quence workers in mental measurements should be careful which one they use 
if they would secure reliable data. 

O. J. Jounson 


St. Paul Public Schools Ass’t Director Research 
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It has been the custom to print in this section personal notices concerni) 
members of the Association, and brief accounts of the problems, on which tly 
are working or of the results of investigations which are not extensive enouch 
to justify writing articles upon them. On the account of the election of a new 
secretary at the last meeting, the members of the Association have not yet 
acquired the habit of sending him material. This is a renewal of the standing 
invitation to send appropriate notices, or literature regarding important me: 
ings, conferences, ete., or concerning scientific investigations which are in 
progress or completed. Let each member send the kind of information about 
himself that he would like to have about his fellow members. Address t! 
secretary at the University of Chicago. 

The secretary proposes to throw the section open to another type of 
communication. It seems to him that it would be profitable to make it a forum 
for brief discussions of problems connected with scientific investigations. The 
problems might be concerned with the technique of investigation or with the 
interpretation of its results. They might be general in their reference or they 
might refer to some particular published study. They should in all cases be 
brief, pointed and specific. Administrative problems arising out of the conduct 
of research or of the scientific survey of school systems might be treated. 
Requests for information on proposed investigations would also be appropriate. 
The suggestion is that the Journal be used as the medium for a continuous 
round-table discussion of our professional problems. 


Leon O. Smith, Assistant Superintendent of Schools of Omaha, will give 
a course in Public School Publicity and one on The Elementary School Curricu- 
lum at the University of Montana during the second term of the coming sum- 
mer session. Mr. Smith has recently been elected President of the Nebraska 
Conference of Social Workers. 


A conference of the Bureau of Educational Reference and Research of the 
University of Michigan was recently held under the direction of Dr. Clifford 
Woody. The program was contributed to by administrators and teachers from 
various parts of the state and consisted chiefly of reports of the use of mental 
or educational tests. Some of the papers will be published in this journal. 
The meeting was well attended and much interest was manifested in the display 
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Some require the underlining of one out of several items, some 
words, some for the completion of sentences. The information e 
sists of dates, names of persons and places connected With important events, 
facts concerning political, social, and industrial movements, ete. The tests 
were given to over 900 pupils of each of the three grades, 
show the comparative scores for the different grades. 

Among the conelusions were the following. Many of the historical facets 
which are taught in the sixth grade are remembered dur 
grades. (Nothing is said in this connection concerning 
elimination.) Fact questions obtained a higher percent o 
ment questions, 
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THE USE OF STANDARDIZED 
ARITHMETIC TESTS 





Thousands of schools are determining the value and extent of arithmetic instrycs; 
by using the standardized arithmetic tests listed below. Armed with the results obtainw 
from the use of these standardized examinations, the superintendent and principal! are j 
a better position to judge both the ability of the teacher and the value of the text used 
The tests by Monroe and Buckingham are in constant demand all over the United State 
The Monroe Generel Survey Arithmetic Test is particularly valuable because it is furnished 
in three forms so that the same pupils can be tested three times during the school year 
mecessary. The Cleveland Survey Arithmetic Test is also a diagnostic test. 





Buckingham Scale for Problems in Arithmetic 
Form 1! 
Sample Set, 8 cents 
Division I, for grades 3 and 4, 80 cents per 100 
Division II, for grades 5 and 6, 80 cents per 100 
Division III, for grades 7 and 8, 80 cents per 100 
Form 2 
Sample Set, 8 cents 
Division I, for grades 3 and 4, 80 cents per 100 
Division If, for grades 5 and 6, 80 cents per 100 
Division Ul, for grades 7 and 8, 80 cents per 100 
Monroe General Survey Arithmetic, See Illinois Examination, (page I of this magaz,,-.) 
Form I. Scale I Monroe's General Survey Arithmetic, for grades 3, 4 and 5, $1.00 per 1X 
Scale II Monroe's General Survey Arithmetic, for graics 6, 7 and 8, $1.00 per 100 
Form 2. Scale I Monroe's General Survey Arithmetic, for grades 3, 4 and 5, $1.00 per 100 
Scale Il Monroe's General Survey Arithmetic, for grades 6, 7 and 8, $1.00 per 100 
Form 3. Scale I Monroe's General Survey Arithmetic, for grades 3, 4 and 5, $1.00 per 100 
Scale If Monroe's General Survey Arithmetic, for grades 6, 7 and 8, $1.00 per 100 


Cleveland Survey Arithmetic Tests, for grades 3 to 8, $1.90 per 100 
Sample Set, 10 cents 
Monroe Diagnostic Tests in Arithmetic 
Sample Set, 10 cents 
Part I, Integers, for grades 4 to 8, 85 cents per 100 
Part II, Integers, for grades 5 to 8, 85 cents per 100 
Part III, Common Fractions, for grades, 6 to 8, 85 cents per 100 
Part IV, Decimal Fractions, for grades 6 to 8, 85 cents per 100 
Monroe Standardized Reasoning Tests in Arithmetic 
Form 1 
Sample Set, 8 cents 
Test I, for grades 4 and 5, 80 cents per 100 
Test II, for grades 6 and 7, 80 cents per 100 
Test III, for grade 8, 89 cents per 100 
Form 2 
Sample Set, 8 cents 
Test I, for grades 4 and 5, 80 cents per 100 
Test Il, for grades 6 and 7, 80 cents per 100 
Test IIl, for grade 8, 80 cents per 100 
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Tests of 
Mental Ability 


By Arthur S. Otis 


Write for fr 


Ready Soon 





An Introduction to the Use of 
Standard Tests 


tendent beginnir 


WORLD BOOK COMPANY 


Yonkers-on-Hudson, New York 2126 Prairie Avenue, Chicago 
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READING SCALES APPLIED TO 
PARTICULAR SUBJECTS 


History 
The Van Wagenen Scales in / General Science 


English Literature 


School authorities find a need for the measurement of the abilit 


to read and comprehend particular school subjects. 

The Van Wagenen series of reading scales will meet just this n 

The Van Wagenen scales aid in determining the degree of diff 
of reading material that may safely be placed in the hands of stud 
of various degrees of capacity. 

The Van Wagenen scales make possible 


aie ai 
rate comparisons of ability in reading vari 


1) relatively acct 


2) relatively accurate measurements of the effects of increa 
range of information in a subject upon a student’s abilit 
to read intelligently in that subject; 

3) relatively accurate measurements of the effect of differ 
methods of study upon ability to read independently i 
certain subject. 

The Van Wagenen Reading Scales are purely reading scales. N 
writing other than the making of check marks is necessary. 

Added to the ease with which the exercises may be scored is t 
ease with which the student’s score may be calculated in terms of 
score value. 

There are duplicate scales for each of the subjects so that accurat 
comparisons of achievement may be made. 


Comparisons of achievement in terms of definite degrees of ability 


may be made, a process that is difficult with the use of ordinary stand 
ard tests. 


THE VAN WAGENEN READING SCALES 


History Scale A (8 pages), or Scale B, price $3.00 per 100. 
General Science Scale A (8 pages), or Scale B, price $3.00 per 100. 
English Literature Scale A (8 pages), or Scale B, or Scale C, price $3.00 per 100. 


THE PUBLIC SCHOOL PUBLISHING CO. 


BLOOMINGTON, ILLINOIS 
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OHIO STATE UNIVERSITY 


Announcements 


COLLEGE OF EDUCATION 


$e. 





SUMMER QUARTER - JUNE 19 to SEPT. 2, 1922 
First Term - June 19 to July 26, 1922 
Second Term - July 27 to Sept. 2, 1922 
FOUR-QUARTER PLAN 
The Ohio State University has adopted the quarter Y ization 
Summer Quarter in the College of Education is divided into tv ms for 
onvemence of teachers who elect to doa h til-quarter wor 
Che Summer Quarter is prepared to meet the needs of Scl Ss rintend i 
ts, High School Principals, Normal School Teachers, Sup ir High ' 
rincipals, Grade Principals, High School Teachers, L:lementary S | hers ' 
ers of Industrial Education, Art Teachers, Mu | he | 
' 
DEGREES 
The quarter plan of organization makes it possible to ohtgin the under 
luate degree (B. S.) and the advanced degrees (A.M. and Ph.D.) by att 
fa succession of Summer Quarters i 
ACADEMIC SUBJECTS 
Undergraduate and graduate content courses will be offered t h school 
1 grammar school teachers in practically all of the a gh | 
cts The University quarter plan of organ ma 
sion of the work in academic subjects. 
PROFESSIONAL SUBJECTS 
Twenty courses will be offered in Principles and Met leaching; i 
en in Psychology; ten in Industrial Education; six in History of Icducatior ' 


fifteen in School Administration; sixteen courses for men and women in 
ation; four courses in Art; nine courses in Musi 
BUREAU OF EDUCATIONAL RESEARCH 
The recently established Bureau of Educational Research under the Director 
»of Dr. B. R. Buckingham, formerlv of the University of Illinois and Editor 
f the J yurnal of I ducational Rese irch, will be pl iced it the service of s h 0] 
iperintendents, principals, and teachers during the summer quarter 


For information address 


The University Examiner 


THE OHIO STATE UNIVERSITY 
COLUMBUS, OHIO 





























WITHAM’S TESTS 
STANDARD GEOGRAPHY 


The only practical diagnostic tests yet de- 
vised in Geography. 
English Vocabulary—tTests 1 and 2 now available 
Silent Reading—Test No. 1. Mechanical Content 
—Test No. 2. Literary Content 
All of the above tests put up in sets of 50 of one kind complete, 


with printed directions for giving and scoring tests, standard scores 


and key. 
We also publish 


BROOKS GRAPH RECORD CARDS and 
MAXSON’'S SELF KEYED NUMBER WORK CARDS 


Write Dept. A for Complete Sample Sets 


J. L. HAMMETT COMPANY 


Cambridge, Massachusetts 




















AMERICAN BOOK COMPANY 


EDUCATIONAL PUBLISHERS 








NEW YORK, 100 Washington Square 
CINCINNATI, 300 Pike Street 
CHICAGO, 330 East 22nd Street 
BOSTON, 63 Summer Street 
ATLANTA, 2 North Forsyth Street 


a 


Address all communications to the nearest office of the company. 
circulars, catalogues, and price lists will be mailed on request to any address. 


Your correspondence is solicited and will have prompt attention. 
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OF ABILITY TO LEARN 


OF ACHIEVEMENT 


Education is, as Bagley says, “training for achievement.” 
And Intelligence, according to the definition offered by Buck- 
ingham and accepted by many leaders, is “the ability to 
learn.” 


Judged by these two standards a test which furnishes you 
reliable data concerning your pupils’ ability to learn and the 
record of achievement they have made in their school work is 
the test you wish to use in your school system. 


THE ILLINOIS EXAMINATION is such a test. 
The first seven pages contain the seven sections of the Illinois 
General Intelligence Test; the remainder of the pamphlet in- 
cludes the Monroe Standardized Silent Reading Test and the 
Monroe Survey Scale in Arithmetic. 


THE ILLINOIS EXAMINATION was the first test to 
furnish teachers a means of determining the pupil’s “achieve- 
ment quotient,” which is now generally regarded as an essen- 
tial part of the general information that the teacher should 
have regarding every pupil under her charge. 


THE ILLINOIS EXAMINATION is used with entire 
satisfaction and success in both city and rural schools. It 
can be, and is, administered by the teachers themselves 
without the necessity of calling in an expert. 


Though this three-barrelled test is one of the very best to 
be had, it is also one of the most economical in price. The 
cost is $4.00 net per hundred copies. We fill orders promptly. 


PUBLIC SCHOOL PUBLISHING COMPANY 
BLOOMINGTON, ILL. 
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